Nov 05 03:35:35 devstack cinder-volume[76139]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 03:35:35 devstack cinder-volume[76139]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:35:35 devstack cinder-volume[76139]: we strongly recommend against using it for new projects.
Nov 05 03:35:35 devstack cinder-volume[76139]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:35:35 devstack cinder-volume[76139]: framework.  For more detail see
Nov 05 03:35:35 devstack cinder-volume[76139]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:35:35 devstack cinder-volume[76139]:   import eventlet  # noqa
Nov 05 03:35:38 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:35:38 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:35:38 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:35:38 devstack cinder-volume[76139]: INFO dbcounter [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Registered counter for database cinder
Nov 05 03:35:39 devstack cinder-volume[76139]: DEBUG oslo_db.sqlalchemy.engines [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:35:39 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writer thread running {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:35:39 devstack cinder-volume[76139]: INFO cinder.rpc [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 03:35:39 devstack cinder-volume[76139]: INFO cinder.rpc [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 03:35:39 devstack cinder-volume[76139]: DEBUG oslo_db.sqlalchemy.engines [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:35:39 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Determined volume DB was empty at startup.
Nov 05 03:35:39 devstack cinder-volume[76139]: DEBUG cinder.volume.manager [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76139) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Nov 05 03:35:39 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 03:35:39 devstack cinder-volume[76139]: WARNING stevedore.named [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:35:39 devstack cinder-volume[76139]: WARNING castellan.key_manager [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:35:39 devstack cinder-volume[76139]: WARNING cinder.keymgr.conf_key_mgr [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:35:39 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76139) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 03:35:39 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] CMD "cinder-rtstool verify" returned: 0 in 0.445s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_db.sqlalchemy.engines [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:35:40 devstack cinder-volume[76139]: INFO cinder.rpc [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 03:35:40 devstack cinder-volume[76139]: INFO cinder.rpc [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version.
Nov 05 03:35:40 devstack cinder-volume[76139]: WARNING stevedore.named [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:35:40 devstack cinder-volume[76139]: WARNING castellan.key_manager [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:35:40 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_db.sqlalchemy.engines [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:35:40 devstack cinder-volume[76139]: INFO oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Starting 1 workers
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Started child 76301 {{(pid=76139) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Full set of CONF: {{(pid=76139) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] ******************************************************************************** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Configuration options gathered from: {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 03:35:40 devstack cinder-volume[76301]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] ================================================================================ {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] allow_availability_zone_fallback = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] allow_compression_on_image_upload = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] allowed_direct_url_schemes     = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] api_rate_limit                 = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] auth_strategy                  = keystone {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] az_cache_duration              = 3600 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_availability_zone      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_host                   = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_name                   = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_stats_polling_interval = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backup_api_class               = cinder.backup.api.API {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backup_name_template           = backup-%s {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backup_use_same_host           = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backup_use_temp_snapshot       = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] changed_blocks_max_limit       = 1000 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] changed_blocks_rpc_timeout     = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] chap_password                  = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] chap_username                  =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_internal_tenant_project_id = 09d613a6259f421aa30f9fc3ff999956 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_internal_tenant_user_id = ebc10631a3294c838d433dbdc3e62f50 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cloned_volume_same_az          = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cluster                        = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] compression_format             = gzip {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] compute_api_class              = cinder.compute.nova.API {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] config_dir                     = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] config_source                  = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] control_exchange               = openstack {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] debug                          = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] default_availability_zone      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] default_group_type             = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] default_volume_type            = lvmdriver-1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] disk_geometry                  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] driver_client_cert             = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] driver_client_cert_key         = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] driver_data_namespace          = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] driver_ssl_cert_path           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] driver_ssl_cert_verify         = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] driver_use_ssl                 = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] enable_force_upload            = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] enable_new_services            = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] enable_unsupported_driver      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] enforce_multipath_for_image_xfer = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] filter_function                = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_api_insecure            = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_api_servers             = ['http://192.168.122.105/image'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_api_ssl_compression     = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_ca_certificates_file    = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_catalog_info            = image:glance:publicURL {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_certfile                = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_keyfile                 = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_num_retries             = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance_request_timeout         = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] goodness_function              = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] graceful_shutdown_timeout      = 5 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] group_api_class                = cinder.group.api.API {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] host                           = devstack {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_compress_on_upload       = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_conversion_address_space_limit = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_conversion_cpu_limit     = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_conversion_disable       = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_upload_use_cinder_backend = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_upload_use_internal_tenant = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_volume_cache_enabled     = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_volume_cache_max_count   = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] image_volume_cache_max_size_gb = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] init_host_max_objects_retrieval = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] instance_format                = [instance: %(uuid)s]  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] iscsi_target_flags             =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] iscsi_write_cache              = on {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] iser_helper                    = tgtadm {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] iser_ip_address                = 192.168.122.105 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] iser_port                      = 3260 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_color                      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_config_append              = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_dir                        = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_file                       = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_options                    = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_rotate_interval            = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_rotate_interval_type       = days {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] log_rotation_type              = none {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] max_age                        = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] max_logfile_count              = 30 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] max_logfile_size_mb            = 200 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] max_over_subscription_ratio    = 20.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] message_reap_interval          = 86400 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] message_ttl                    = 2592000 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] migration_create_volume_timeout_secs = 300 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] monkey_patch                   = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] monkey_patch_modules           = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] my_ip                          = 192.168.122.105 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] no_snapshot_gb_quota           = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] num_iser_scan_tries            = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] num_shell_tries                = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] num_volume_device_scan_tries   = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] nvmeof_conn_info_version       = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] nvmet_ns_id                    = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] nvmet_port_id                  = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] osapi_max_limit                = 1000 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] osapi_volume_ext_list          = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] osapi_volume_listen_port       = 8776 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] osapi_volume_use_ssl           = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] osapi_volume_workers           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] per_volume_size_limit          = -1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] periodic_fuzzy_delay           = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] periodic_interval              = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] public_endpoint                = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] publish_errors                 = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] quota_backup_gigabytes         = 1000 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] quota_backups                  = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] quota_gigabytes                = 1000 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] quota_groups                   = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] quota_snapshots                = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] quota_volumes                  = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] rate_limit_burst               = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] rate_limit_except_level        = CRITICAL {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] rate_limit_interval            = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] reinit_driver_count            = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] replication_device             = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] report_discard_supported       = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] report_interval                = 120 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] reservation_clean_interval     = 86400 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] reservation_expire             = 86400 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] reserved_image_namespaces      = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] reserved_percentage            = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] rpc_response_timeout           = 120 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] run_external_periodic_tasks    = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] scst_target_driver             = iscsi {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] scst_target_iqn_name           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_down_time              = 720 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] shell_completion               = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] snapshot_name_template         = snapshot-%s {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] snapshot_same_host             = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] split_loggers                  = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] state_path                     = /opt/stack/data/cinder {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] storage_availability_zone      = nova {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] storage_protocol               = iSCSI {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] syslog_log_facility            = LOG_USER {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] target_helper                  = lioadm {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] target_ip_address              = 192.168.122.105 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] target_port                    = 3260 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] target_protocol                = iscsi {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] target_secondary_ip_addresses  = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] trace_flags                    = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] transport_url                  = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] until_refresh                  = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] use_chap_auth                  = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] use_default_quota_class        = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] use_journal                    = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] use_json                       = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] use_multipath_for_image_xfer   = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] use_stderr                     = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] use_syslog                     = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] verify_glance_signatures       = enabled {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_api_class               = cinder.volume.api.API {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_backend_name            = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_clear                   = zero {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_clear_ionice            = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_clear_size              = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_copy_bps_limit          = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_dd_blocksize            = 1M {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_name_template           = volume-%s {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_service_inithost_offload = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volume_usage_audit_period      = month {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] zoning_mode                    = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:35:40 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_concurrency.disable_process_locking = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.auth_section = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.auth_type   = password {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.auth_version = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.cache       = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.certfile    = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.delay_auth_decision = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.http_connect_timeout = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.include_service_catalog = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.insecure    = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.interface   = public {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.keyfile     = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_password = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcache_username = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.region_name = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.service_token_roles_required = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.service_type = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.token_cache_time = 300 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.backend                  = dogpile.cache.null {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.backend_argument         = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.backend_expiration_time  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.config_prefix            = cache.oslo {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.debug_cache_backend      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.enable_retry_client      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.enable_socket_keepalive  = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.enabled                  = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.expiration_time          = 600 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.hashclient_retry_attempts = 2 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.memcache_dead_retry      = 300 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.memcache_pool_maxsize    = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.memcache_sasl_enabled    = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.password                 = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.proxies                  = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.redis_db                 = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.redis_sentinel_service_name = mymaster {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.redis_server             = localhost:6379 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.retry_attempts           = 2 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.retry_delay              = 0.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.socket_keepalive_count   = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.socket_keepalive_idle    = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.socket_keepalive_interval = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.socket_timeout           = 1.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.tls_allowed_ciphers      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.tls_cafile               = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.tls_certfile             = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.tls_enabled              = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.tls_keyfile              = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cache.username                 = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] coordination.backend_url       = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.asyncio_connection    = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.asyncio_slave_connection = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.backend               = sqlalchemy {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.connection            = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.connection_debug      = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.connection_parameters =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.connection_recycle_time = 3600 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.connection_trace      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.db_inc_retry_interval = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.db_max_retries        = 20 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.db_max_retry_interval = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.db_retry_interval     = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.max_overflow          = 50 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.max_pool_size         = 5 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.max_retries           = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.mysql_wsrep_sync_wait = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.pool_timeout          = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.retry_interval        = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.slave_connection      = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.sqlite_synchronous    = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.synchronous_reader    = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] database.use_db_reconnect      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_tracing.insecure = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.connection_string     = messaging:// {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.enabled               = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.es_doc_type           = notification {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.es_scroll_size        = 10000 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.es_scroll_time        = 2m {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.filter_error_trace    = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.hmac_keys             = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.sentinel_service_name = mymaster {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.socket_timeout        = 0.1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.trace_requests        = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler.trace_sqlalchemy      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler_jaeger.process_tags   = {} {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler_jaeger.service_name_prefix = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] profiler_otlp.service_name_prefix = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.enforce_new_defaults = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.policy_default_rule = default {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.policy_file        = policy.yaml {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] privsep_osbrick.group          = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] privsep_osbrick.helper_command = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] privsep_osbrick.user           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_sys_admin.group         = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_sys_admin.helper_command = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] cinder_sys_admin.user          = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.auth_section      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.auth_type         = password {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.cafile            = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.certfile          = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.collect_timing    = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.insecure          = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack sudo[76305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.keyfile           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.send_service_user_token = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.split_loggers     = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.timeout           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.tls_ciphers       = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] service_user.tls_min_version   = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.auth_section            = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack sudo[76305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.auth_type               = password {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.certfile                = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.collect_timing          = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.insecure                = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.keyfile                 = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.region_name             = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.split_loggers           = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.timeout                 = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.tls_ciphers             = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] glance.tls_min_version         = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.backend_availability_zone = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.chap_password = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.chap_username =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.disk_geometry = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.driver_client_cert = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.driver_client_cert_key = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.driver_data_namespace = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.driver_use_ssl = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.enable_unsupported_driver = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.extra_capabilities = {} {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.filter_function = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.goodness_function = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.iscsi_target_flags =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.iscsi_write_cache = on {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.iser_helper   = tgtadm {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.iser_port     = 3260 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.lvm_share_target = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.lvm_type      = auto {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.num_shell_tries = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.nvmet_port_id = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.replication_device = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.report_discard_supported = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.reserved_percentage = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.scst_target_driver = iscsi {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.scst_target_iqn_name = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.storage_protocol = iSCSI {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.target_helper = tgtadm {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.target_port   = 3260 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.target_protocol = iscsi {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.trace_flags   = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.unique_fqdn_network = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.use_chap_auth = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_backend_name = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_clear  = zero {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_clear_ionice = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_clear_size = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_reports.file_event_handler = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_reports.log_dir           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.backend_availability_zone = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.backend_host       = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.chap_password      = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.chap_username      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.disk_geometry      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.driver_client_cert = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.driver_data_namespace = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.extra_capabilities = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.filter_function    = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.goodness_function  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.iser_helper        = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.iser_ip_address    = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.iser_port          = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.iser_target_prefix = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.lvm_share_target   = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.lvm_type           = auto {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.num_shell_tries    = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.replication_device = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.report_discard_supported = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.reserved_percentage = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.scst_target_driver = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.storage_protocol   = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.target_helper      = lioadm {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.target_ip_address  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.target_port        = 3260 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.trace_flags        = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.use_chap_auth      = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_clear       = zero {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_clear_size  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] lvmdriver-1.volumes_dir        = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.ssl      = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_notifications.driver = [] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_notifications.retry = -1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] oslo_messaging_notifications.transport_url = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] key_manager.fixed_key          = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.barbican_api_version  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.barbican_endpoint     = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.barbican_endpoint_type = public {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.barbican_region_name  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.cafile                = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.certfile              = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.collect_timing        = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.insecure              = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.keyfile               = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.number_of_retries     = 60 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.retry_delay           = 1 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.send_service_user_token = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.split_loggers         = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.timeout               = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.tls_ciphers           = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.tls_min_version       = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.verify_ssl            = True {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican.verify_ssl_path       = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.auth_section = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.auth_type = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.cafile   = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.certfile = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.collect_timing = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.insecure = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.keyfile  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.split_loggers = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.timeout  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.tls_ciphers = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] barbican_service_user.tls_min_version = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.approle_role_id          = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.approle_secret_id        = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.auth_method              = approle {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.auth_path                = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.kv_mountpoint            = secret {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.kv_path                  = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.kv_version               = 2 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.namespace                = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.root_token_id            = **** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.ssl_ca_crt_file          = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.timeout                  = 60.0 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.token_file               = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.token_role               = None {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.use_ssl                  = False {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:35:40 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] ******************************************************************************** {{(pid=76139) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 03:35:41 devstack sudo[76305]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.408s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:41 devstack sudo[76311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:41 devstack sudo[76311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:41 devstack sudo[76311]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.321s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:35:41 devstack cinder-volume[76301]: INFO cinder.brick.local_dev.lvm [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:41 devstack sudo[76444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:35:41 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:41 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.373s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG cinder.brick.local_dev.lvm [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76301) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 03:35:41 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:41 devstack sudo[76539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:41 devstack sudo[76539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:42 devstack sudo[76539]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.526s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:42 devstack sudo[76744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:42 devstack sudo[76744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:42 devstack sudo[76744]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:42 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:42 devstack sudo[76841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 03:35:42 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:43 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.363s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:43 devstack sudo[76922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:35:43 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:43 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:43 devstack sudo[76997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:35:43 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:43 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:43 devstack sudo[77010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:35:43 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:43 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:43 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:44 devstack sudo[77076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:44 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:44 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.396s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:44 devstack sudo[77103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:44 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:44 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:44 devstack cinder-volume[76301]: INFO cinder.volume.drivers.lvm [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:44 devstack sudo[77113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:44 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:44 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:35:44 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:45 devstack sudo[77116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:35:45 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:45 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:45 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:45 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:45 devstack sudo[77119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:35:45 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:45 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:45 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:45 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:45 devstack sudo[77122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:45 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:45 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:45 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:45 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:45 devstack sudo[77125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:35:45 devstack sudo[77125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:46 devstack sudo[77125]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:46 devstack cinder-volume[76301]: INFO cinder.volume.driver [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG cinder.volume.driver [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76301) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG oslo_db.sqlalchemy.engines [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writer thread running {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG cinder.db.api [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Building query based on filter {{(pid=76301) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG cinder.image.image_utils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76301) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Nov 05 03:35:46 devstack cinder-volume[76301]: INFO cinder.keymgr.migration [None req-fa51295a-946b-45a7-a813-ad3a080d049b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:46 devstack sudo[77131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:35:46 devstack sudo[77131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:46 devstack sudo[77131]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:46 devstack sudo[77134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:35:46 devstack sudo[77134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:46 devstack sudo[77134]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:46 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:46 devstack sudo[77138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:46 devstack sudo[77138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:47 devstack sudo[77138]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:47 devstack sudo[77142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:35:47 devstack sudo[77142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:47 devstack sudo[77142]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:35:47 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Driver initialization completed successfully.
Nov 05 03:35:47 devstack cinder-volume[76301]: INFO cinder.manager [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Initiating service 2 cleanup
Nov 05 03:35:47 devstack cinder-volume[76301]: INFO cinder.manager [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Service 2 cleanup completed.
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG cinder.service [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Creating RPC server for service cinder-volume {{(pid=76301) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG cinder.service [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76301) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 03:35:47 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:47 devstack sudo[77146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:35:47 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:47 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:47 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:48 devstack sudo[77153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:35:48 devstack sudo[77153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:48 devstack sudo[77153]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:48 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:48 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:48 devstack sudo[77156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:35:48 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:48 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:48 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:48 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:35:48 devstack sudo[77159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:35:48 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:35:48 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root
Nov 05 03:35:48 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:35:48 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-86c87f4c-1775-4fcd-992a-e29423e21154 None None] Driver post RPC initialization completed successfully.
Nov 05 03:35:50 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:35:58 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=3 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:35:58 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:36:16 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager._thread_info {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:36:16 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread count: 6 {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:36:16 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread info: [<_MainThread(MainThread, started 124188582019200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124188467620672)>, <Thread(Thread-3 (stat_writer), started daemon 124188468392768)>, <Thread(Rabbit-heartbeat, started daemon 124188471516736)>, <Thread(Thread-5 (_runner), started daemon 124188467200448)>, <Thread(Thread-7 (_runner), started daemon 124188465285952)>] {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:37:16 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:37:16 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:37:16 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:16 devstack sudo[80889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:37:16 devstack sudo[80889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[80889]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:17 devstack sudo[81117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:37:17 devstack sudo[81117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[81117]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:17 devstack sudo[81265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:37:17 devstack sudo[81265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[81265]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:17 devstack sudo[81477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:37:17 devstack sudo[81477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[81477]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager._thread_info {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread count: 6 {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:37:17 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread info: [<_MainThread(MainThread, started 124188582019200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124188467620672)>, <Thread(Thread-3 (stat_writer), started daemon 124188468392768)>, <Thread(Rabbit-heartbeat, started daemon 124188471516736)>, <Thread(Thread-5 (_runner), started daemon 124188467200448)>, <Thread(Thread-7 (_runner), started daemon 124188465285952)>] {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:37:58 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:38:16 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:38:16 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:38:16 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:16 devstack sudo[83547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:38:16 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:17 devstack sudo[83554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:38:17 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:17 devstack sudo[83557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:38:17 devstack sudo[83557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[83557]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:17 devstack sudo[83560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:38:17 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:39:16 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:39:16 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:39:16 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:16 devstack sudo[85171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:39:16 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:17 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:17 devstack sudo[85174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:39:17 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:17 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:17 devstack sudo[85188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:39:17 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:17 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:17 devstack sudo[85191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:39:17 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:17 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager._thread_info {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread count: 6 {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:39:17 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread info: [<_MainThread(MainThread, started 124188582019200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124188467620672)>, <Thread(Thread-3 (stat_writer), started daemon 124188468392768)>, <Thread(Rabbit-heartbeat, started daemon 124188471516736)>, <Thread(Thread-5 (_runner), started daemon 124188467200448)>, <Thread(Thread-7 (_runner), started daemon 124188465285952)>] {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:39:58 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:40:16 devstack cinder-volume[76139]: INFO oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Caught SIGTERM, stopping children
Nov 05 03:40:16 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Acquiring lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:40:16 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Acquired lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:40:16 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Releasing lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:40:16 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Stop services. {{(pid=76139) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 03:40:16 devstack cinder-volume[76139]: DEBUG oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Killing children. {{(pid=76139) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 03:40:16 devstack cinder-volume[76139]: INFO oslo_service.backend._eventlet.service [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Waiting on 1 children to exit
Nov 05 03:40:16 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:40:16 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:40:16 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:16 devstack sudo[86330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:40:16 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:17 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:17 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:40:17 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:17 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:17 devstack sudo[86336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:40:17 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:17 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:17 devstack sudo[86339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:40:17 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:17 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] Running periodic task VolumeManager._thread_info {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread count: 6 {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:40:17 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-e298c18d-2db1-4b19-904d-9721339bfc96 None None] thread info: [<_MainThread(MainThread, started 124188582019200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124188467620672)>, <Thread(Thread-3 (stat_writer), started daemon 124188468392768)>, <Thread(Rabbit-heartbeat, started daemon 124188471516736)>, <Thread(Thread-5 (_runner), started daemon 124188467200448)>, <Thread(Thread-7 (_runner), started daemon 124188465285952)>] {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:40:21 devstack cinder-volume[76301]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Nov 05 03:40:21 devstack cinder-volume[86345]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 03:40:21 devstack cinder-volume[86345]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:40:21 devstack cinder-volume[86345]: we strongly recommend against using it for new projects.
Nov 05 03:40:21 devstack cinder-volume[86345]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:40:21 devstack cinder-volume[86345]: framework.  For more detail see
Nov 05 03:40:21 devstack cinder-volume[86345]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:40:21 devstack cinder-volume[86345]:   import eventlet  # noqa
Nov 05 03:40:22 devstack cinder-volume[76301]: DEBUG oslo_concurrency.lockutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Acquiring lock "singleton_lock" {{(pid=76301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:40:22 devstack cinder-volume[76301]: DEBUG oslo_concurrency.lockutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Acquired lock "singleton_lock" {{(pid=76301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:40:22 devstack cinder-volume[76301]: DEBUG oslo_concurrency.lockutils [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Releasing lock "singleton_lock" {{(pid=76301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:40:22 devstack cinder-volume[76301]: WARNING amqp [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:40:22 devstack cinder-volume[76301]: WARNING amqp [None req-fa6493a7-4215-4bb8-963e-709f843da7ba None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:40:23 devstack cinder-volume[86345]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:40:23 devstack cinder-volume[86345]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:40:23 devstack cinder-volume[86345]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:40:24 devstack cinder-volume[86345]: INFO dbcounter [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Registered counter for database cinder
Nov 05 03:40:24 devstack cinder-volume[86345]: DEBUG oslo_db.sqlalchemy.engines [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG dbcounter [-] [86345] Writer thread running {{(pid=86345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:40:25 devstack cinder-volume[86345]: INFO cinder.rpc [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 03:40:25 devstack cinder-volume[86345]: INFO cinder.rpc [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_db.sqlalchemy.engines [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:25 devstack cinder-volume[86345]: INFO cinder.volume.manager [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Determined volume DB was empty at startup.
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG cinder.volume.manager [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86345) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Nov 05 03:40:25 devstack cinder-volume[86345]: INFO cinder.volume.manager [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 03:40:25 devstack cinder-volume[86345]: WARNING stevedore.named [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:40:25 devstack cinder-volume[86345]: WARNING castellan.key_manager [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:40:25 devstack cinder-volume[86345]: WARNING cinder.keymgr.conf_key_mgr [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:40:25 devstack cinder-volume[86345]: INFO cinder.volume.manager [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_db.sqlalchemy.engines [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:25 devstack cinder-volume[86345]: INFO oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Starting 1 workers
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Started child 86571 {{(pid=86345) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Full set of CONF: {{(pid=86345) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] ******************************************************************************** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Configuration options gathered from: {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] ================================================================================ {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] allow_availability_zone_fallback = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86571]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] allow_compression_on_image_upload = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] allowed_direct_url_schemes     = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] api_rate_limit                 = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] auth_strategy                  = keystone {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_availability_zone      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_host                   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_name                   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_stats_polling_interval = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backup_api_class               = cinder.backup.api.API {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backup_name_template           = backup-%s {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backup_use_same_host           = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backup_use_temp_snapshot       = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] changed_blocks_max_limit       = 1000 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] changed_blocks_rpc_timeout     = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] chap_password                  = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] chap_username                  =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_internal_tenant_project_id = 09d613a6259f421aa30f9fc3ff999956 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_internal_tenant_user_id = ebc10631a3294c838d433dbdc3e62f50 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cluster                        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] compression_format             = gzip {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] config_dir                     = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] config_source                  = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] control_exchange               = openstack {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] debug                          = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] default_availability_zone      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] default_group_type             = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] default_volume_type            = QuobyteHD {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] disk_geometry                  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] driver_client_cert             = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] driver_client_cert_key         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] driver_data_namespace          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] driver_ssl_cert_path           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] driver_ssl_cert_verify         = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] driver_use_ssl                 = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] enable_new_services            = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] enable_unsupported_driver      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] enforce_multipath_for_image_xfer = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] filter_function                = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_api_insecure            = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_api_servers             = ['http://192.168.122.105/image'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_api_ssl_compression     = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_ca_certificates_file    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_certfile                = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_keyfile                 = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_num_retries             = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance_request_timeout         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] goodness_function              = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] graceful_shutdown_timeout      = 5 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] group_api_class                = cinder.group.api.API {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] host                           = devstack {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_compress_on_upload       = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_conversion_address_space_limit = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_conversion_cpu_limit     = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_conversion_disable       = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_upload_use_cinder_backend = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_upload_use_internal_tenant = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_volume_cache_enabled     = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_volume_cache_max_count   = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] init_host_max_objects_retrieval = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86571]: INFO cinder.volume.manager [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Starting volume driver QuobyteDriver (1.2)
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] iscsi_target_flags             =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] iscsi_write_cache              = on {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.remotefs [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86571) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] iser_helper                    = tgtadm {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] iser_ip_address                = 192.168.122.105 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] iser_port                      = 3260 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_color                      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_config_append              = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_dir                        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_file                       = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_options                    = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_rotate_interval            = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_rotate_interval_type       = days {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] log_rotation_type              = none {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] max_age                        = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] max_logfile_count              = 30 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] max_logfile_size_mb            = 200 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] max_over_subscription_ratio    = 20.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] message_reap_interval          = 86400 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] message_ttl                    = 2592000 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] monkey_patch                   = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] monkey_patch_modules           = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] my_ip                          = 192.168.122.105 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] no_snapshot_gb_quota           = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] num_iser_scan_tries            = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] num_shell_tries                = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] num_volume_device_scan_tries   = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] nvmeof_conn_info_version       = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] nvmet_ns_id                    = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] nvmet_port_id                  = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] osapi_max_limit                = 1000 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] osapi_volume_ext_list          = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] osapi_volume_listen_port       = 8776 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] osapi_volume_use_ssl           = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] osapi_volume_workers           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] per_volume_size_limit          = -1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] periodic_fuzzy_delay           = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] periodic_interval              = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] public_endpoint                = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] publish_errors                 = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] quota_backup_gigabytes         = 1000 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] quota_backups                  = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] quota_gigabytes                = 1000 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] quota_groups                   = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] quota_snapshots                = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] quota_volumes                  = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] rate_limit_burst               = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] rate_limit_except_level        = CRITICAL {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] rate_limit_interval            = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] reinit_driver_count            = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] replication_device             = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] report_discard_supported       = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] report_interval                = 120 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] reservation_clean_interval     = 86400 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] reservation_expire             = 86400 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] reserved_image_namespaces      = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] reserved_percentage            = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] rpc_response_timeout           = 120 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] run_external_periodic_tasks    = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] scst_target_driver             = iscsi {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] scst_target_iqn_name           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_down_time              = 720 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] shell_completion               = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] snapshot_name_template         = snapshot-%s {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] split_loggers                  = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] state_path                     = /opt/stack/data/cinder {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] storage_availability_zone      = nova {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] storage_protocol               = iSCSI {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] syslog_log_facility            = LOG_USER {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] target_helper                  = lioadm {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] target_ip_address              = 192.168.122.105 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] target_port                    = 3260 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] target_protocol                = iscsi {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] target_secondary_ip_addresses  = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] trace_flags                    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] transport_url                  = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] until_refresh                  = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] use_chap_auth                  = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] use_default_quota_class        = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] use_journal                    = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] use_json                       = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] use_multipath_for_image_xfer   = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] use_stderr                     = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] use_syslog                     = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] verify_glance_signatures       = enabled {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_api_class               = cinder.volume.api.API {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_backend_name            = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_clear                   = zero {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_clear_ionice            = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_clear_size              = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_copy_bps_limit          = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_dd_blocksize            = 1M {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_name_template           = volume-%s {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_service_inithost_offload = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volume_usage_audit_period      = month {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] zoning_mode                    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.auth_section = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.auth_type   = password {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.auth_version = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.cache       = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.certfile    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.insecure    = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.interface   = public {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.keyfile     = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_password = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcache_username = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.region_name = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.service_type = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.backend                  = dogpile.cache.null {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.backend_argument         = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86571) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.backend_expiration_time  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.config_prefix            = cache.oslo {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.debug_cache_backend      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.enable_retry_client      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: WARNING cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 03:40:25 devstack cinder-volume[86571]: WARNING cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.enable_socket_keepalive  = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.enabled                  = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.expiration_time          = 600 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Running cmd (subprocess): mount.quobyte {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.memcache_dead_retry      = 300 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.memcache_sasl_enabled    = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.password                 = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.proxies                  = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.redis_db                 = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.redis_server             = localhost:6379 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.retry_attempts           = 2 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.retry_delay              = 0.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.socket_keepalive_count   = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.socket_keepalive_idle    = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.socket_keepalive_interval = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.socket_timeout           = 1.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.tls_allowed_ciphers      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.tls_cafile               = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.tls_certfile             = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.tls_enabled              = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.tls_keyfile              = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cache.username                 = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] coordination.backend_url       = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.asyncio_connection    = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.asyncio_slave_connection = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.backend               = sqlalchemy {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.connection            = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.connection_debug      = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.connection_parameters =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.connection_recycle_time = 3600 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.connection_trace      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.db_inc_retry_interval = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.db_max_retries        = 20 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.db_max_retry_interval = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.db_retry_interval     = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.max_overflow          = 50 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.max_pool_size         = 5 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.max_retries           = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.pool_timeout          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.retry_interval        = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.slave_connection      = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.sqlite_synchronous    = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.synchronous_reader    = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] database.use_db_reconnect      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_tracing.insecure = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.connection_string     = messaging:// {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.enabled               = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.es_doc_type           = notification {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.es_scroll_size        = 10000 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.es_scroll_time        = 2m {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.filter_error_trace    = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.hmac_keys             = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.sentinel_service_name = mymaster {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.socket_timeout        = 0.1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.trace_requests        = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler.trace_sqlalchemy      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler_jaeger.process_tags   = {} {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] profiler_otlp.service_name_prefix = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.policy_default_rule = default {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] privsep_osbrick.group          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] privsep_osbrick.helper_command = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] privsep_osbrick.user           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_sys_admin.group         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_sys_admin.helper_command = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] cinder_sys_admin.user          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.auth_section      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.auth_type         = password {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.cafile            = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.certfile          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.collect_timing    = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.insecure          = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.keyfile           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.send_service_user_token = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.split_loggers     = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.timeout           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.tls_ciphers       = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] service_user.tls_min_version   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.auth_section            = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.auth_type               = password {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.certfile                = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.collect_timing          = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.insecure                = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.keyfile                 = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.region_name             = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.split_loggers           = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.timeout                 = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.tls_ciphers             = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] glance.tls_min_version         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.backend_availability_zone = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.chap_password = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.chap_username =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.disk_geometry = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.driver_client_cert = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.driver_data_namespace = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.driver_use_ssl = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.extra_capabilities = {} {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.filter_function = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.goodness_function = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.iscsi_target_flags =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.iser_port     = 3260 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_host      =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_login     = admin {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_mount_options = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_password  = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_private_key =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_share_path =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=86571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.replication_device = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.report_discard_supported = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: INFO cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a ...
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e -c /etc/quobyte/client-cinder.cfg {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.target_helper = tgtadm {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.target_port   = 3260 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.target_protocol = iscsi {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.trace_flags   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.use_chap_auth = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_backend_name = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_clear  = zero {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_reports.file_event_handler = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_reports.log_dir           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.backend_host         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.chap_password        = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.chap_username        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.disk_geometry        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.driver_client_cert   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.extra_capabilities   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.filter_function      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.goodness_function    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.iser_helper          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.iser_ip_address      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.iser_port            = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_host             = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_login            = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_mount_options    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_password         = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_private_key      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_share_path       = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.num_shell_tries      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.replication_device   = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.report_discard_supported = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.reserved_percentage  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.scst_target_driver   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.storage_protocol     = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.target_helper        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.target_ip_address    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.target_port          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.target_prefix        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.target_protocol      = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.trace_flags          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.use_chap_auth        = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_clear         = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_clear_size    = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e -c /etc/quobyte/client-cinder.cfg
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] QuobyteHD.volumes_dir          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_notifications.driver = [] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] key_manager.fixed_key          = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.barbican_api_version  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.barbican_endpoint     = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.barbican_endpoint_type = public {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.barbican_region_name  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.cafile                = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.certfile              = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.collect_timing        = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.insecure              = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.keyfile               = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.number_of_retries     = 60 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.retry_delay           = 1 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.send_service_user_token = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.split_loggers         = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.timeout               = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.tls_ciphers           = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.tls_min_version       = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.verify_ssl            = True {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican.verify_ssl_path       = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.auth_section = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.auth_type = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.cafile   = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.certfile = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.collect_timing = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.insecure = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.keyfile  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.split_loggers = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.timeout  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.tls_ciphers = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] barbican_service_user.tls_min_version = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.approle_role_id          = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.approle_secret_id        = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.auth_method              = approle {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.auth_path                = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.kv_mountpoint            = secret {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.kv_path                  = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.kv_version               = 2 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.namespace                = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.root_token_id            = **** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.ssl_ca_crt_file          = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.timeout                  = 60.0 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.token_file               = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.token_role               = None {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.use_ssl                  = False {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:25 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] ******************************************************************************** {{(pid=86345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 03:40:26 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.615s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:26 devstack cinder-volume[86571]: INFO cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a succeeded
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=86571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.638s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:26 devstack sudo[86688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:40:26 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:26 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.390s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:26 devstack cinder-volume[86571]: INFO cinder.volume.driver [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG cinder.volume.driver [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86571) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_db.sqlalchemy.engines [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86571) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG dbcounter [-] [86571] Writer thread running {{(pid=86571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG cinder.db.api [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Building query based on filter {{(pid=86571) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG cinder.image.image_utils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86571) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Nov 05 03:40:26 devstack cinder-volume[86571]: INFO cinder.keymgr.migration [None req-c5ec24cf-82d2-4ac7-9926-14ab335fbfa0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=86571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=86571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:26 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:26 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:40:26 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:27 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.381s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG cinder.manager [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Notifying Schedulers of capabilities ... {{(pid=86571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:27 devstack cinder-volume[86571]: INFO cinder.volume.manager [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Driver initialization completed successfully.
Nov 05 03:40:27 devstack cinder-volume[86571]: INFO cinder.manager [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Initiating service 3 cleanup
Nov 05 03:40:27 devstack cinder-volume[86571]: INFO cinder.manager [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Service 3 cleanup completed.
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG cinder.service [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Creating RPC server for service cinder-volume {{(pid=86571) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG cinder.service [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86571) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 03:40:27 devstack cinder-volume[86571]: INFO cinder.volume.manager [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=86571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=86571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:27 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:27 devstack sudo[86736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:40:27 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:28 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:28 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.552s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:28 devstack cinder-volume[86571]: INFO cinder.volume.manager [None req-c0e650d8-2845-4c59-8f31-3d3b0c539969 None None] Driver post RPC initialization completed successfully.
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=86571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG cinder.volume.drivers.quobyte [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=86571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:32 devstack sudo[86944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:40:32 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:32 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG oslo_concurrency.processutils [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.289s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:32 devstack cinder-volume[86571]: DEBUG cinder.manager [None req-a0e59b2c-7b77-460b-9ffd-6b1fa5eb110d None None] Notifying Schedulers of capabilities ... {{(pid=86571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:33 devstack cinder-volume[86345]: INFO oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Caught SIGTERM, stopping children
Nov 05 03:40:33 devstack cinder-volume[86345]: DEBUG oslo_concurrency.lockutils [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Acquiring lock "singleton_lock" {{(pid=86345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:40:33 devstack cinder-volume[86345]: DEBUG oslo_concurrency.lockutils [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Acquired lock "singleton_lock" {{(pid=86345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:40:33 devstack cinder-volume[86345]: DEBUG oslo_concurrency.lockutils [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Releasing lock "singleton_lock" {{(pid=86345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:40:33 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Stop services. {{(pid=86345) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 03:40:33 devstack cinder-volume[86345]: DEBUG oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Killing children. {{(pid=86345) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 03:40:33 devstack cinder-volume[86345]: INFO oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Waiting on 1 children to exit
Nov 05 03:40:35 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Acquiring lock "singleton_lock" {{(pid=86571) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:40:35 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Acquired lock "singleton_lock" {{(pid=86571) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:40:35 devstack cinder-volume[86571]: DEBUG oslo_concurrency.lockutils [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Releasing lock "singleton_lock" {{(pid=86571) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:40:35 devstack cinder-volume[86571]: WARNING amqp [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:40:35 devstack cinder-volume[86571]: WARNING amqp [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:40:35 devstack cinder-volume[86345]: INFO oslo_service.backend._eventlet.service [None req-295177c0-bb0e-491d-aa09-f6c1c66646e8 None None] Child 86571 exited with status 0
Nov 05 03:40:36 devstack cinder-volume[87085]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 03:40:36 devstack cinder-volume[87085]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:40:36 devstack cinder-volume[87085]: we strongly recommend against using it for new projects.
Nov 05 03:40:36 devstack cinder-volume[87085]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:40:36 devstack cinder-volume[87085]: framework.  For more detail see
Nov 05 03:40:36 devstack cinder-volume[87085]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:40:36 devstack cinder-volume[87085]:   import eventlet  # noqa
Nov 05 03:40:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87085) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:40:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87085) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:40:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87085) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:40:41 devstack cinder-volume[87085]: INFO dbcounter [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Registered counter for database cinder
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87085) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writer thread running {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:40:41 devstack cinder-volume[87085]: INFO cinder.rpc [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 03:40:41 devstack cinder-volume[87085]: INFO cinder.rpc [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87085) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Determined volume DB was empty at startup.
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87085) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Nov 05 03:40:41 devstack cinder-volume[87085]: WARNING stevedore.named [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:40:41 devstack cinder-volume[87085]: WARNING castellan.key_manager [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:40:41 devstack cinder-volume[87085]: WARNING cinder.keymgr.conf_key_mgr [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:40:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87085) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:41 devstack cinder-volume[87085]: INFO oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Starting 1 workers
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Started child 87401 {{(pid=87085) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Full set of CONF: {{(pid=87085) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] ******************************************************************************** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] Configuration options gathered from: {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] ================================================================================ {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] allow_availability_zone_fallback = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] allow_compression_on_image_upload = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] allowed_direct_url_schemes     = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] api_rate_limit                 = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] auth_strategy                  = keystone {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_availability_zone      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_host                   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_name                   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_stats_polling_interval = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backup_api_class               = cinder.backup.api.API {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backup_name_template           = backup-%s {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backup_use_same_host           = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backup_use_temp_snapshot       = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] changed_blocks_max_limit       = 1000 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] changed_blocks_rpc_timeout     = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] chap_password                  = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] chap_username                  =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:41 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_internal_tenant_project_id = 09d613a6259f421aa30f9fc3ff999956 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87401]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_internal_tenant_user_id = ebc10631a3294c838d433dbdc3e62f50 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cluster                        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] compression_format             = gzip {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] config_dir                     = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] config_source                  = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] control_exchange               = openstack {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] debug                          = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] default_availability_zone      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] default_group_type             = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] default_volume_type            = QuobyteHD {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] disk_geometry                  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] driver_client_cert             = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] driver_client_cert_key         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] driver_data_namespace          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] driver_ssl_cert_path           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] driver_ssl_cert_verify         = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] driver_use_ssl                 = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] enable_new_services            = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] enable_unsupported_driver      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] enforce_multipath_for_image_xfer = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] filter_function                = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_api_insecure            = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_api_servers             = ['http://192.168.122.105/image'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_api_ssl_compression     = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_ca_certificates_file    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_certfile                = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_keyfile                 = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_num_retries             = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance_request_timeout         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] goodness_function              = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] graceful_shutdown_timeout      = 5 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] group_api_class                = cinder.group.api.API {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] host                           = devstack {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_compress_on_upload       = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_conversion_address_space_limit = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_conversion_cpu_limit     = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_conversion_disable       = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_upload_use_cinder_backend = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_upload_use_internal_tenant = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_volume_cache_enabled     = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_volume_cache_max_count   = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] image_volume_cache_max_size_gb = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] init_host_max_objects_retrieval = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] iscsi_target_flags             =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] iscsi_write_cache              = on {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] iser_helper                    = tgtadm {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] iser_ip_address                = 192.168.122.105 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] iser_port                      = 3260 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_color                      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_config_append              = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_dir                        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_file                       = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_options                    = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_rotate_interval            = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_rotate_interval_type       = days {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] log_rotation_type              = none {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] max_age                        = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] max_logfile_count              = 30 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] max_logfile_size_mb            = 200 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] max_over_subscription_ratio    = 20.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] message_reap_interval          = 86400 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] message_ttl                    = 2592000 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] migration_create_volume_timeout_secs = 300 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] monkey_patch                   = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] monkey_patch_modules           = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] my_ip                          = 192.168.122.105 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] no_snapshot_gb_quota           = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] num_iser_scan_tries            = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] num_shell_tries                = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] num_volume_device_scan_tries   = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] nvmeof_conn_info_version       = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] nvmet_ns_id                    = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] nvmet_port_id                  = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] osapi_max_limit                = 1000 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] osapi_volume_ext_list          = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] osapi_volume_listen_port       = 8776 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] osapi_volume_use_ssl           = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] osapi_volume_workers           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] per_volume_size_limit          = -1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] periodic_fuzzy_delay           = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] periodic_interval              = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] public_endpoint                = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] publish_errors                 = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] quota_backup_gigabytes         = 1000 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] quota_backups                  = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] quota_gigabytes                = 1000 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] quota_groups                   = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] quota_snapshots                = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] quota_volumes                  = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] rate_limit_burst               = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] rate_limit_except_level        = CRITICAL {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] rate_limit_interval            = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] reinit_driver_count            = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] replication_device             = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] report_discard_supported       = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] report_interval                = 120 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] reservation_clean_interval     = 86400 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] reservation_expire             = 86400 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] reserved_image_namespaces      = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] reserved_percentage            = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] rpc_response_timeout           = 120 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] run_external_periodic_tasks    = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] scst_target_driver             = iscsi {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] scst_target_iqn_name           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_down_time              = 720 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] shell_completion               = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack sudo[87407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] snapshot_name_template         = snapshot-%s {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] split_loggers                  = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] state_path                     = /opt/stack/data/cinder {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] storage_availability_zone      = nova {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] storage_protocol               = iSCSI {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] syslog_log_facility            = LOG_USER {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] target_helper                  = lioadm {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] target_ip_address              = 192.168.122.105 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] target_port                    = 3260 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] target_protocol                = iscsi {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] target_secondary_ip_addresses  = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] trace_flags                    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] transport_url                  = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] until_refresh                  = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] use_chap_auth                  = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] use_default_quota_class        = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] use_journal                    = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] use_json                       = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] use_multipath_for_image_xfer   = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] use_stderr                     = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] use_syslog                     = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] verify_glance_signatures       = enabled {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_api_class               = cinder.volume.api.API {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_backend_name            = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_clear                   = zero {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_clear_ionice            = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_clear_size              = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_copy_bps_limit          = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_dd_blocksize            = 1M {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_name_template           = volume-%s {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_service_inithost_offload = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volume_usage_audit_period      = month {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] zoning_mode                    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.auth_section = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.auth_type   = password {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.auth_version = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.cache       = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.certfile    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.include_service_catalog = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.insecure    = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.interface   = public {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.keyfile     = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_password = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Starting volume driver QuobyteDriver (1.2)
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87401) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcache_username = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.region_name = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.service_type = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.backend                  = dogpile.cache.null {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.backend_argument         = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.backend_expiration_time  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.config_prefix            = cache.oslo {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.debug_cache_backend      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.enable_retry_client      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.enable_socket_keepalive  = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.enabled                  = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.expiration_time          = 600 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.memcache_dead_retry      = 300 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.memcache_sasl_enabled    = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.password                 = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.proxies                  = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.redis_db                 = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.redis_server             = localhost:6379 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.retry_attempts           = 2 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.retry_delay              = 0.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.socket_keepalive_count   = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.socket_keepalive_idle    = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.socket_keepalive_interval = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.socket_timeout           = 1.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.tls_allowed_ciphers      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.tls_cafile               = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.tls_certfile             = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.tls_enabled              = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.tls_keyfile              = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cache.username                 = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] coordination.backend_url       = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.asyncio_connection    = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.asyncio_slave_connection = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.backend               = sqlalchemy {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.connection            = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.connection_debug      = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.connection_parameters =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.connection_recycle_time = 3600 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.connection_trace      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.db_inc_retry_interval = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.db_max_retries        = 20 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.db_max_retry_interval = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.db_retry_interval     = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.max_overflow          = 50 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.max_pool_size         = 5 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.max_retries           = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.pool_timeout          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.retry_interval        = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.slave_connection      = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.sqlite_synchronous    = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.synchronous_reader    = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] database.use_db_reconnect      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_tracing.insecure = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.connection_string     = messaging:// {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.enabled               = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.es_doc_type           = notification {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.es_scroll_size        = 10000 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.es_scroll_time        = 2m {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.filter_error_trace    = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.hmac_keys             = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.sentinel_service_name = mymaster {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.socket_timeout        = 0.1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.trace_requests        = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler.trace_sqlalchemy      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler_jaeger.process_tags   = {} {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] profiler_otlp.service_name_prefix = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.policy_default_rule = default {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] privsep_osbrick.group          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] privsep_osbrick.helper_command = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] privsep_osbrick.user           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_sys_admin.group         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_sys_admin.helper_command = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] cinder_sys_admin.user          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.auth_section      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.auth_type         = password {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.cafile            = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.certfile          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.collect_timing    = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.insecure          = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.keyfile           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.send_service_user_token = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.split_loggers     = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.timeout           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.tls_ciphers       = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] service_user.tls_min_version   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.auth_section            = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.auth_type               = password {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.certfile                = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.collect_timing          = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.insecure                = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.keyfile                 = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.region_name             = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.split_loggers           = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.timeout                 = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.tls_ciphers             = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] glance.tls_min_version         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.backend_availability_zone = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.chap_password = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.chap_username =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.disk_geometry = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.driver_client_cert = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.driver_client_cert_key = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.driver_data_namespace = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.driver_use_ssl = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.extra_capabilities = {} {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.filter_function = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.goodness_function = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.iscsi_target_flags =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.iscsi_write_cache = on {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.iser_port     = 3260 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_host      =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_login     = admin {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_mount_options = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_password  = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_private_key =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_share_path =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.num_shell_tries = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.quobyte_volume_url = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.replication_device = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.report_discard_supported = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.reserved_percentage = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.target_helper = tgtadm {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.target_port   = 3260 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.target_protocol = iscsi {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.trace_flags   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.unique_fqdn_network = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.use_chap_auth = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_backend_name = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_clear  = zero {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_clear_ionice = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_clear_size = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_reports.file_event_handler = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_reports.log_dir           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.backend_availability_zone = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.backend_host         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.chap_password        = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.chap_username        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.disk_geometry        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.driver_client_cert   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.driver_data_namespace = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.extra_capabilities   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.filter_function      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.goodness_function    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.iser_helper          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.iser_ip_address      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.iser_port            = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_host             = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_login            = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_mount_options    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_password         = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_private_key      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_share_path       = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.num_shell_tries      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87401) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Nov 05 03:40:42 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 03:40:42 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Running cmd (subprocess): mount.quobyte {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.replication_device   = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.report_discard_supported = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.reserved_percentage  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.scst_target_driver   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.storage_protocol     = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.target_helper        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.target_ip_address    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.target_port          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.target_prefix        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.target_protocol      = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.trace_flags          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.use_chap_auth        = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_clear         = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_clear_size    = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] QuobyteHD.volumes_dir          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_notifications.driver = [] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] key_manager.fixed_key          = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.barbican_api_version  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.barbican_endpoint     = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.barbican_endpoint_type = public {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.barbican_region_name  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.cafile                = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.certfile              = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.collect_timing        = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.insecure              = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.keyfile               = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.number_of_retries     = 60 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.retry_delay           = 1 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.send_service_user_token = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.split_loggers         = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.timeout               = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.tls_ciphers           = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.tls_min_version       = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.verify_ssl            = True {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican.verify_ssl_path       = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.auth_section = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.auth_type = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.cafile   = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.certfile = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.collect_timing = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.insecure = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.keyfile  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.split_loggers = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.timeout  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.tls_ciphers = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] barbican_service_user.tls_min_version = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.approle_role_id          = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.approle_secret_id        = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.auth_method              = approle {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.auth_path                = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.kv_mountpoint            = secret {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.kv_path                  = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.kv_version               = 2 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.namespace                = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.root_token_id            = **** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.ssl_ca_crt_file          = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.timeout                  = 60.0 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.token_file               = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.token_role               = None {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.use_ssl                  = False {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:40:42 devstack cinder-volume[87085]: DEBUG oslo_service.backend._eventlet.service [None req-5b0ec7d4-79c7-4946-a3f0-e9a8bbc481b2 None None] ******************************************************************************** {{(pid=87085) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:42 devstack cinder-volume[87401]: INFO cinder.volume.driver [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.volume.driver [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_db.sqlalchemy.engines [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writer thread running {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.db.api [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Building query based on filter {{(pid=87401) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87401) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:42 devstack cinder-volume[87401]: INFO cinder.keymgr.migration [None req-2f5b90dd-3c4a-4b31-9784-0b19556e6084 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 03:40:43 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Driver initialization completed successfully.
Nov 05 03:40:43 devstack cinder-volume[87401]: INFO cinder.manager [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Initiating service 3 cleanup
Nov 05 03:40:43 devstack cinder-volume[87401]: INFO cinder.manager [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Service 3 cleanup completed.
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG cinder.service [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Creating RPC server for service cinder-volume {{(pid=87401) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG cinder.service [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87401) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 03:40:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:43 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:40:43 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:43 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b4317a37-396f-4455-b428-5efd36c66f10 None None] Driver post RPC initialization completed successfully.
Nov 05 03:40:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:40:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:40:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=3 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:41:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:41:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 6 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:41:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Flow 'volume_create_manager' (5341abbb-8241-444b-8cc4-2e39771e8aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496ccc5e-b6da-4625-80c0-3c013fcaf376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496ccc5e-b6da-4625-80c0-3c013fcaf376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1799325011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e88991-530c-460b-a3d2-534546d0f1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8480228af48640dc8fcd4a3fbb05bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:42Z,use_quota=True,user_id='8fb17ba106c04326b556a769a9da4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f5b077-8983-474e-9ac9-964cba12e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f5b077-8983-474e-9ac9-964cba12e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffc2af6-a758-4d02-8e25-e106293744c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffc2af6-a758-4d02-8e25-e106293744c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e88991-530c-460b-a3d2-534546d0f1ca', 'volume_name': 'volume-76e88991-530c-460b-a3d2-534546d0f1ca', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcf1414-5400-4218-a784-e2c0cbd643ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcf1414-5400-4218-a784-e2c0cbd643ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d2f1ae-0054-41fa-8d77-7ed647809c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Volume 76e88991-530c-460b-a3d2-534546d0f1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e88991-530c-460b-a3d2-534546d0f1ca', 'volume_size': 1}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1799325011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e88991-530c-460b-a3d2-534546d0f1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8480228af48640dc8fcd4a3fbb05bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:42Z,use_quota=True,user_id='8fb17ba106c04326b556a769a9da4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Creating volume 76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:41:41 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:41:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:41 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca 1073741824
Nov 05 03:41:41 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Flow 'volume_create_manager' (803397a0-fdbc-4f05-8f4c-9a19e149fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da66c364-e627-4612-ae2a-10fbdf72bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da66c364-e627-4612-ae2a-10fbdf72bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1849138002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df68777-624a-4ec4-824a-523898df7719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb314cce9eb64e33bed64130d3749fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:42Z,use_quota=True,user_id='fec66a8e377f46b2ae01c2d09932c03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae53bda-f355-4f02-a7cb-3b404ae8de32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae53bda-f355-4f02-a7cb-3b404ae8de32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02c9f02-ef27-4526-ba65-545e9d31913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02c9f02-ef27-4526-ba65-545e9d31913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df68777-624a-4ec4-824a-523898df7719', 'volume_name': 'volume-1df68777-624a-4ec4-824a-523898df7719', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4744edab-b1e7-46d2-9649-771ff97b3e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4744edab-b1e7-46d2-9649-771ff97b3e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17534405-15e9-4634-ba47-0b1f3b7d2645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Volume 1df68777-624a-4ec4-824a-523898df7719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df68777-624a-4ec4-824a-523898df7719', 'volume_size': 1}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:42 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca 1073741824" returned: 0 in 0.771s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:42 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca
Nov 05 03:41:42 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:42 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca" returned: 0 in 0.247s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:41:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1849138002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df68777-624a-4ec4-824a-523898df7719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb314cce9eb64e33bed64130d3749fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:42Z,use_quota=True,user_id='fec66a8e377f46b2ae01c2d09932c03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Creating volume 1df68777-624a-4ec4-824a-523898df7719 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:41:43 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d2f1ae-0054-41fa-8d77-7ed647809c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e88991-530c-460b-a3d2-534546d0f1ca', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:43 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719 1073741824
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43587279-8362-4f09-a8dc-87b7796e75e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:43 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Volume volume-76e88991-530c-460b-a3d2-534546d0f1ca (76e88991-530c-460b-a3d2-534546d0f1ca): created successfully
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43587279-8362-4f09-a8dc-87b7796e75e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Flow 'volume_create_manager' (5341abbb-8241-444b-8cc4-2e39771e8aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-67b4ea7c-587e-411b-a434-b1a28b693b47 req-2f860bae-9510-4c4d-a236-fffa55e59f9e tempest-VolumesSnapshotsTestJSON-1649046446 None] Created volume successfully.
Nov 05 03:41:43 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719 1073741824" returned: 0 in 0.603s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:43 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719
Nov 05 03:41:43 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:43 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.113s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17534405-15e9-4634-ba47-0b1f3b7d2645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df68777-624a-4ec4-824a-523898df7719', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06129c9f-b46a-4c0c-b275-c0fab7437bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Creating offline snapshot 39caa269-efd2-469c-88fd-adcdacdb4ecb of volume 76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:41:44 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmper5mm8c_/privsep.sock']
Nov 05 03:41:44 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Volume volume-1df68777-624a-4ec4-824a-523898df7719 (1df68777-624a-4ec4-824a-523898df7719): created successfully
Nov 05 03:41:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06129c9f-b46a-4c0c-b275-c0fab7437bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Flow 'volume_create_manager' (803397a0-fdbc-4f05-8f4c-9a19e149fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:44 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmper5mm8c_/privsep.sock
Nov 05 03:41:44 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:44 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5266b7fa-f832-474f-9ed2-34802942646b tempest-TaggedAttachmentsTest-158282243 None] Created volume successfully.
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 03:41:45 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 03:41:45 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:45 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Spawned new privsep daemon via rootwrap
Nov 05 03:41:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Accepted privsep connection to /tmp/tmper5mm8c_/privsep.sock {{(pid=87401) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 03:41:45 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 03:41:45 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 03:41:45 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 03:41:45 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87876
Nov 05 03:41:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9d4c5-3a19-4a43-9ba2-165c6c58ddcf]: (2,) {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd44ad73-421a-4be1-9c23-15bb6c88d9a3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:45 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca
Nov 05 03:41:45 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:46 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:46 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb 1G
Nov 05 03:41:46 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:46 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb 1G" returned: 0 in 0.581s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e88991-530c-460b-a3d2-534546d0f1ca -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:46 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e88991-530c-460b-a3d2-534546d0f1ca -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb
Nov 05 03:41:46 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:47 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e88991-530c-460b-a3d2-534546d0f1ca -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:47 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb is being set with open permissions: ugo+rw
Nov 05 03:41:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:47 devstack sudo[87895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb
Nov 05 03:41:47 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:47 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:47 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.info
Nov 05 03:41:47 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:47 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.info" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:47 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.info is being set with open permissions: ugo+rw
Nov 05 03:41:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:47 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.info
Nov 05 03:41:47 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:48 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.info" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.086s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-685ada14-e937-4292-9e21-c7b259d85ad4 req-682f9f64-e7d7-4e37-80ba-04a81a9312d3 tempest-VolumesSnapshotsTestJSON-1649046446 None] Create snapshot completed successfully
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "cinder-39caa269-efd2-469c-88fd-adcdacdb4ecb-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-39caa269-efd2-469c-88fd-adcdacdb4ecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "cinder-quobyte-76e88991-530c-460b-a3d2-534546d0f1ca" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-quobyte-76e88991-530c-460b-a3d2-534546d0f1ca" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "cinder-quobyte-39caa269-efd2-469c-88fd-adcdacdb4ecb" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-quobyte-39caa269-efd2-469c-88fd-adcdacdb4ecb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Deleting offline snapshot 39caa269-efd2-469c-88fd-adcdacdb4ecb of volume 76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] snapshot_file for this snap is: volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16b05f-164f-4510-b58a-3ac6436dd768]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:49 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb
Nov 05 03:41:49 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:49 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb" returned: 0 in 0.472s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76e88991-530c-460b-a3d2-534546d0f1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c812886-1342-439c-89ab-096423a08694]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:49 devstack sudo[87913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca
Nov 05 03:41:49 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:50 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:50 devstack sudo[87918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb
Nov 05 03:41:50 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:50 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb" returned: 0 in 0.483s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:50 devstack sudo[87925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb
Nov 05 03:41:50 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:50 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca.39caa269-efd2-469c-88fd-adcdacdb4ecb" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-quobyte-39caa269-efd2-469c-88fd-adcdacdb4ecb" released by "_delete_snapshot" :: held 1.865s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-quobyte-76e88991-530c-460b-a3d2-534546d0f1ca" released by "delete_snapshot" :: held 1.898s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:51 devstack cinder-volume[87401]: WARNING cinder.quota [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:41:51 devstack cinder-volume[87401]: WARNING cinder.quota [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.quota [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Created reservations ['b26cdec6-de65-4c23-83d6-d08237737804', '5e11ef8b-2115-4dad-bcf5-c6a863f3f951', 'f7f1d8f1-0291-4dfa-bbff-e2409fea6d7f', '7b202195-b154-494c-8e2c-9636e3768849'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:41:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Delete snapshot completed successfully.
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ef639f54-7ef0-4bf0-8a91-bd83b6ddb75e req-47481161-e97d-46d5-9f0b-dc9001ec8d84 tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-39caa269-efd2-469c-88fd-adcdacdb4ecb-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "cinder-76e88991-530c-460b-a3d2-534546d0f1ca-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-76e88991-530c-460b-a3d2-534546d0f1ca-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "cinder-quobyte-76e88991-530c-460b-a3d2-534546d0f1ca" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-quobyte-76e88991-530c-460b-a3d2-534546d0f1ca" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e415263e-68b3-46ae-bd05-64266012bad9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:51 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca
Nov 05 03:41:51 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:52 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca" returned: 0 in 0.444s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:52 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca
Nov 05 03:41:52 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:52 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-76e88991-530c-460b-a3d2-534546d0f1ca" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-quobyte-76e88991-530c-460b-a3d2-534546d0f1ca" released by "delete_volume" :: held 1.050s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:52 devstack cinder-volume[87401]: WARNING cinder.quota [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG cinder.quota [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Created reservations ['9db0a4bf-e98d-4f73-8419-e4e946f3ca0f', 'ceb977ff-04df-41aa-9d8e-f06a828bf1ea', '65431f45-5268-40d1-afac-373bdb2b6999', '7e8a7b5e-1b71-4e8c-81ef-481cf4fb45f3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:52 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:41:52 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:53 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:53 devstack cinder-volume[87401]: DEBUG cinder.manager [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:41:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Deleted volume successfully.
Nov 05 03:41:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-41b5f8cf-c67a-4b57-8f4d-98438b2476db req-739bf991-295e-474f-b0eb-69dd1503ffdc tempest-VolumesSnapshotsTestJSON-1649046446 None] Lock "cinder-76e88991-530c-460b-a3d2-534546d0f1ca-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:02 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=23,cinder:SELECT=15,cinder:INSERT=7 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:42:03 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=22,cinder:DELETE=4,cinder:UPDATE=19,cinder:INSERT=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:42:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:42:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:10 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:42:10 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:11 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.780s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:42:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 8 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:42:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Flow 'volume_create_manager' (2451051b-0dfd-467d-8a66-ea18a902ddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b426aae4-2897-40f0-8c2d-1576810583b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b426aae4-2897-40f0-8c2d-1576810583b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-215801389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2a38ab-0a99-4082-902b-9909a934992d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75b0ab58df34089859138f5d772059d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:12Z,use_quota=True,user_id='e8f6b4adb150418a8ce1a119978c9139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127562ba-4fe4-4bc5-a0b9-7e6c34e3d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127562ba-4fe4-4bc5-a0b9-7e6c34e3d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c802c387-e511-45a3-bb64-cc4e09ff1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c802c387-e511-45a3-bb64-cc4e09ff1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2a38ab-0a99-4082-902b-9909a934992d', 'volume_name': 'volume-6c2a38ab-0a99-4082-902b-9909a934992d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb939cd0-a9dd-4642-9ed1-b9d74341cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb939cd0-a9dd-4642-9ed1-b9d74341cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb67263-e392-432f-acbd-f8769cf66992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Volume 6c2a38ab-0a99-4082-902b-9909a934992d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2a38ab-0a99-4082-902b-9909a934992d', 'volume_size': 1}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-215801389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2a38ab-0a99-4082-902b-9909a934992d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75b0ab58df34089859138f5d772059d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:12Z,use_quota=True,user_id='e8f6b4adb150418a8ce1a119978c9139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Creating volume 6c2a38ab-0a99-4082-902b-9909a934992d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:42:12 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:42:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:12 devstack sudo[88246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d 1073741824
Nov 05 03:42:12 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:14 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d 1073741824" returned: 0 in 1.372s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:14 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d
Nov 05 03:42:14 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:15 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d" returned: 0 in 0.864s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:42:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.365s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb67263-e392-432f-acbd-f8769cf66992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2a38ab-0a99-4082-902b-9909a934992d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98a7ad3-72eb-435c-9d14-71fc4aab4802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Volume volume-6c2a38ab-0a99-4082-902b-9909a934992d (6c2a38ab-0a99-4082-902b-9909a934992d): created successfully
Nov 05 03:42:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98a7ad3-72eb-435c-9d14-71fc4aab4802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Flow 'volume_create_manager' (2451051b-0dfd-467d-8a66-ea18a902ddb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-08bb2b4d-cb72-49cf-b2e3-b2a047495ba0 tempest-VolumesAdminNegativeTest-751792636 None] Created volume successfully.
Nov 05 03:42:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Acquiring lock "cinder-6c2a38ab-0a99-4082-902b-9909a934992d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Lock "cinder-6c2a38ab-0a99-4082-902b-9909a934992d-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Acquiring lock "cinder-quobyte-6c2a38ab-0a99-4082-902b-9909a934992d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Lock "cinder-quobyte-6c2a38ab-0a99-4082-902b-9909a934992d" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:18 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b258faea-0aac-4b5d-ad1e-1fa5c51b7fad]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:18 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d
Nov 05 03:42:18 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:18 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d" returned: 0 in 0.681s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:18 devstack sudo[88344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d
Nov 05 03:42:18 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:19 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6c2a38ab-0a99-4082-902b-9909a934992d" returned: 0 in 0.703s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Lock "cinder-quobyte-6c2a38ab-0a99-4082-902b-9909a934992d" released by "delete_volume" :: held 1.463s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Created reservations ['8408ae81-b351-43c1-9895-fd894f565b1d', 'e999632f-855e-4d48-a801-489ae8147540', '2a8eb5a4-db70-4a4b-a763-d089393308bc', 'd9d080a7-89c1-427f-bf41-41cba2fcfee3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:19 devstack sudo[88349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:42:19 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:20 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:20 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Deleted volume successfully.
Nov 05 03:42:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-95042b04-e9be-45f2-8ea4-87cf4ce72e7a tempest-VolumesAdminNegativeTest-751792636 None] Lock "cinder-6c2a38ab-0a99-4082-902b-9909a934992d-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-65fd9ff1-253b-4d01-b590-f19e210166fa tempest-GroupsV314Test-336235148 None] Group tempest-GroupsV314Test-Group-332732545: creating
Nov 05 03:42:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-65fd9ff1-253b-4d01-b590-f19e210166fa tempest-GroupsV314Test-336235148 None] Group tempest-GroupsV314Test-Group-332732545: created successfully
Nov 05 03:42:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-65fd9ff1-253b-4d01-b590-f19e210166fa tempest-GroupsV314Test-336235148 None] Create group completed successfully.
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Flow 'volume_create_manager' (9fc7472b-c018-491c-baa2-0cabcd3b68b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cd51d6-6f40-40b1-b54d-5cab72e6fcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cd51d6-6f40-40b1-b54d-5cab72e6fcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-564194476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=895804ea-b0dc-4670-b7cc-37e2a45e8c04,host='devstack@QuobyteHD#QuobyteHD',id=e71e91d3-4728-4b06-a53c-9b29f84d13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c11471897fe455fbc600202ccfa97e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:30Z,use_quota=True,user_id='b7f60a5e91194f7dbcae5ff2b2dedbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0deaaca5-9a6a-4faa-8200-4153c1aef3d5),volume_type_id=0deaaca5-9a6a-4faa-8200-4153c1aef3d5)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbed0fea-1e87-4256-aeaa-ec9a9596f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbed0fea-1e87-4256-aeaa-ec9a9596f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e12197-31df-444c-b197-89f726fe0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e12197-31df-444c-b197-89f726fe0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71e91d3-4728-4b06-a53c-9b29f84d13f3', 'volume_name': 'volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02cc7b8-de53-4d69-b86d-859fbdd611fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02cc7b8-de53-4d69-b86d-859fbdd611fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43cde1-36b5-493a-a57d-7e9c17f2110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:30 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Volume e71e91d3-4728-4b06-a53c-9b29f84d13f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3', 'volume_size': 1}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=895804ea-b0dc-4670-b7cc-37e2a45e8c04,created_at=2026-11-05T02:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-564194476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=895804ea-b0dc-4670-b7cc-37e2a45e8c04,host='devstack@QuobyteHD#QuobyteHD',id=e71e91d3-4728-4b06-a53c-9b29f84d13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c11471897fe455fbc600202ccfa97e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:30Z,use_quota=True,user_id='b7f60a5e91194f7dbcae5ff2b2dedbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0deaaca5-9a6a-4faa-8200-4153c1aef3d5),volume_type_id=0deaaca5-9a6a-4faa-8200-4153c1aef3d5)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Creating volume e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:42:30 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:30 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 1073741824
Nov 05 03:42:30 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:30 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 1073741824" returned: 0 in 0.517s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:30 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3
Nov 05 03:42:30 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:31 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3" returned: 0 in 0.295s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:42:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43cde1-36b5-493a-a57d-7e9c17f2110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542bc617-8d98-44a9-aebe-be228143ca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:31 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Volume volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 (e71e91d3-4728-4b06-a53c-9b29f84d13f3): created successfully
Nov 05 03:42:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542bc617-8d98-44a9-aebe-be228143ca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Flow 'volume_create_manager' (9fc7472b-c018-491c-baa2-0cabcd3b68b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-35de8501-d25a-45e2-bb54-b81edb9ecabf tempest-GroupsV314Test-336235148 None] Created volume successfully.
Nov 05 03:42:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Cloning volume e71e91d3-4728-4b06-a53c-9b29f84d13f3 to volume b425fbe5-5064-4eee-96f5-7e16deb44deb
Nov 05 03:42:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Creating offline snapshot 1da61427-a028-489b-8b3e-4ede1cd91fbf of volume e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:42:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b46ccd1-ba58-48f7-bdbb-86a55fe5d28d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:33 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3
Nov 05 03:42:33 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:34 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3" returned: 0 in 0.647s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:34 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf 1G
Nov 05 03:42:34 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:34 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf 1G" returned: 0 in 0.558s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:34 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf
Nov 05 03:42:34 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:35 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:42:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:35 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf
Nov 05 03:42:35 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:35 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:35 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.info
Nov 05 03:42:35 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:36 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.info" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:36 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:36 devstack sudo[88501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.info
Nov 05 03:42:36 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:36 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.info" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Acquiring lock "cinder-quobyte-b425fbe5-5064-4eee-96f5-7e16deb44deb" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-b425fbe5-5064-4eee-96f5-7e16deb44deb" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] snapshot: 1da61427-a028-489b-8b3e-4ede1cd91fbf, volume: b425fbe5-5064-4eee-96f5-7e16deb44deb,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b71c5a-5a50-43a6-b13f-e4356a6610ab]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:36 devstack sudo[88505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf
Nov 05 03:42:36 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:37 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf" returned: 0 in 0.634s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d282a6e-8432-4ee7-b49e-1c90f5c3d554]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:37 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3
Nov 05 03:42:37 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:37 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3" returned: 0 in 0.716s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:42:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:37 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb
Nov 05 03:42:37 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Flow 'volume_create_manager' (7d2785de-10d2-4f42-b09b-d1169b8c218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f872cc05-9dbe-49df-9766-00bd7202d79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f872cc05-9dbe-49df-9766-00bd7202d79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1520249694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949a045f-1539-4864-bd52-ee1ca58cf51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b546c315e14c6fbdf2c366269184b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:43Z,use_quota=True,user_id='1db5d21d00c84e009e5008a1d0976b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99163793-9290-41bf-98b6-2fbeb8dacaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99163793-9290-41bf-98b6-2fbeb8dacaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa67a6-006e-4ce0-93a9-692c51ae7d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa67a6-006e-4ce0-93a9-692c51ae7d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949a045f-1539-4864-bd52-ee1ca58cf51b', 'volume_name': 'volume-949a045f-1539-4864-bd52-ee1ca58cf51b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa454c9-c829-4d74-9644-19fde8125b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa454c9-c829-4d74-9644-19fde8125b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd823e6-ceee-45ab-98df-44697b012411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Volume 949a045f-1539-4864-bd52-ee1ca58cf51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949a045f-1539-4864-bd52-ee1ca58cf51b', 'volume_size': 1}
Nov 05 03:42:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:50 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb" returned: 0 in 12.653s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:50 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3, size 1024.00 MB, duration 12.65 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:42:50 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Converted 1024.00 MB image at 80.93 MB/s
Nov 05 03:42:50 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:42:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:50 devstack sudo[88639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb
Nov 05 03:42:50 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:51 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb" returned: 0 in 0.575s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-b425fbe5-5064-4eee-96f5-7e16deb44deb" released by "_copy_volume_from_snapshot" :: held 14.705s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Acquiring lock "cinder-quobyte-1da61427-a028-489b-8b3e-4ede1cd91fbf" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-1da61427-a028-489b-8b3e-4ede1cd91fbf" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Deleting offline snapshot 1da61427-a028-489b-8b3e-4ede1cd91fbf of volume e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] snapshot_file for this snap is: volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab113a-8a31-4aa8-a95b-c8269499b67b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:51 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf
Nov 05 03:42:51 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:52 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf" returned: 0 in 0.809s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:42:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5451319d-e131-4453-911a-1e698089589a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:52 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3
Nov 05 03:42:52 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:52 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3" returned: 0 in 0.718s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:52 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf
Nov 05 03:42:52 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:53 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf" returned: 0 in 0.439s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:53 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf
Nov 05 03:42:53 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=16,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:42:53 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3.1da61427-a028-489b-8b3e-4ede1cd91fbf" returned: 0 in 0.277s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-1da61427-a028-489b-8b3e-4ede1cd91fbf" released by "_delete_snapshot" :: held 2.472s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.201s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.906s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1520249694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949a045f-1539-4864-bd52-ee1ca58cf51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b546c315e14c6fbdf2c366269184b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:43Z,use_quota=True,user_id='1db5d21d00c84e009e5008a1d0976b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Creating volume 949a045f-1539-4864-bd52-ee1ca58cf51b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:42:53 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:42:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:53 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b 1073741824
Nov 05 03:42:53 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7a6a6f20-3179-4cc2-9e20-30a997091a51 tempest-GroupsV314Test-336235148 None] Create group from source-group-895804ea-b0dc-4670-b7cc-37e2a45e8c04 completed successfully.
Nov 05 03:42:54 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b 1073741824" returned: 0 in 0.752s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:54 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b
Nov 05 03:42:54 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Acquiring lock "cinder-quobyte-b425fbe5-5064-4eee-96f5-7e16deb44deb" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-b425fbe5-5064-4eee-96f5-7e16deb44deb" acquired by "delete_volume" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d600a29f-4af0-42cf-ae1e-decdb4173366]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:55 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b" returned: 0 in 0.492s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd823e6-ceee-45ab-98df-44697b012411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949a045f-1539-4864-bd52-ee1ca58cf51b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e762f8-b61b-4736-b004-641240ba0fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Volume volume-949a045f-1539-4864-bd52-ee1ca58cf51b (949a045f-1539-4864-bd52-ee1ca58cf51b): created successfully
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e762f8-b61b-4736-b004-641240ba0fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Flow 'volume_create_manager' (7d2785de-10d2-4f42-b09b-d1169b8c218e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0bb72d36-1465-41b3-8e1e-aaafaee9809d tempest-DeleteServersTestJSON-1338297834 None] Created volume successfully.
Nov 05 03:42:55 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb
Nov 05 03:42:55 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:55 devstack cinder-volume[87401]: WARNING py.warnings [req-7d67df43-f5b0-4e4b-b012-9fe4b2bfda6d req-4ce51c34-d2a9-42e3-8304-6dbda2869248 tempest-TaggedAttachmentsTest-158282243 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 05 03:42:55 devstack cinder-volume[87401]:   .first()
Nov 05 03:42:55 devstack cinder-volume[87401]: 
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7d67df43-f5b0-4e4b-b012-9fe4b2bfda6d req-4ce51c34-d2a9-42e3-8304-6dbda2869248 tempest-TaggedAttachmentsTest-158282243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7d67df43-f5b0-4e4b-b012-9fe4b2bfda6d req-4ce51c34-d2a9-42e3-8304-6dbda2869248 tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7d67df43-f5b0-4e4b-b012-9fe4b2bfda6d req-4ce51c34-d2a9-42e3-8304-6dbda2869248 tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7d67df43-f5b0-4e4b-b012-9fe4b2bfda6d req-4ce51c34-d2a9-42e3-8304-6dbda2869248 tempest-TaggedAttachmentsTest-158282243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-1df68777-624a-4ec4-824a-523898df7719', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d7f8a26-2828-4980-ad95-71ca23649925', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:42:55 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb" returned: 0 in 0.599s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:55 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb
Nov 05 03:42:55 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7d67df43-f5b0-4e4b-b012-9fe4b2bfda6d req-4ce51c34-d2a9-42e3-8304-6dbda2869248 tempest-TaggedAttachmentsTest-158282243 None] attachment_update completed successfully.
Nov 05 03:42:55 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b425fbe5-5064-4eee-96f5-7e16deb44deb" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-b425fbe5-5064-4eee-96f5-7e16deb44deb" released by "delete_volume" :: held 1.004s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Created reservations ['b752d554-ab00-4c6c-88ca-cfcad4fedf09'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:56 devstack cinder-volume[87401]: WARNING cinder.quota [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-827108048 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-827108048, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:42:56 devstack cinder-volume[87401]: WARNING cinder.quota [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-827108048 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-827108048, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Created reservations ['2673ad4c-7235-43b8-81fc-cc8f3f8f9374', '025f3dda-9c2e-477c-82ce-5ad801693c28', '6dce5924-2f01-44e8-8fa5-8c23e1b53bb6', '54f4f4fc-a0cc-425b-b0bc-9c2625d96fb2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:56 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:42:56 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:56 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.412s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:56 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8c222d5b-f658-4384-831e-105a71c09529 tempest-GroupsV314Test-336235148 None] Delete group completed successfully.
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Acquiring lock "cinder-quobyte-e71e91d3-4728-4b06-a53c-9b29f84d13f3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-e71e91d3-4728-4b06-a53c-9b29f84d13f3" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c59f8f-847d-4f0f-a462-948d3c89d562]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:58 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3
Nov 05 03:42:58 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ccbe3c0f-6620-4b62-aee7-9092145a9fcb req-cfbc1ee9-9267-4967-ac4e-666193dfc2fe tempest-DeleteServersTestJSON-1338297834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ccbe3c0f-6620-4b62-aee7-9092145a9fcb req-cfbc1ee9-9267-4967-ac4e-666193dfc2fe tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ccbe3c0f-6620-4b62-aee7-9092145a9fcb req-cfbc1ee9-9267-4967-ac4e-666193dfc2fe tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ccbe3c0f-6620-4b62-aee7-9092145a9fcb req-cfbc1ee9-9267-4967-ac4e-666193dfc2fe tempest-DeleteServersTestJSON-1338297834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-949a045f-1539-4864-bd52-ee1ca58cf51b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b72bf91a-587f-40b5-b5d7-057337a0640d', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:42:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ccbe3c0f-6620-4b62-aee7-9092145a9fcb req-cfbc1ee9-9267-4967-ac4e-666193dfc2fe tempest-DeleteServersTestJSON-1338297834 None] attachment_update completed successfully.
Nov 05 03:42:59 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3" returned: 0 in 0.656s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:59 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3
Nov 05 03:42:59 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:59 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e71e91d3-4728-4b06-a53c-9b29f84d13f3" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Lock "cinder-quobyte-e71e91d3-4728-4b06-a53c-9b29f84d13f3" released by "delete_volume" :: held 1.206s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Created reservations ['6f63ec49-4cbe-4586-8a06-b4df4e4235c7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:04 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=45,cinder:UPDATE=38,cinder:INSERT=9 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:43:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Created reservations ['d8d9ade5-9446-4324-a5cf-6b65b0842b21', 'cb65435c-fc3e-4202-89b8-3384fc4752b9', '748087ff-1352-4356-a8b9-bc54678194a8', '9681e53e-659e-4ad0-9551-c9d4ea5ece0c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:05 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:43:05 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:05 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.466s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:05 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-473c0a48-b6c6-4470-b3bf-22d7253b436d tempest-GroupsV314Test-336235148 None] Delete group completed successfully.
Nov 05 03:43:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-a185cf35-4ae6-41ed-884d-0cd1b0ce88b2 req-e324fc73-c878-4623-9c13-0e1efafd96f2 tempest-TaggedAttachmentsTest-158282243 None] Terminate volume connection completed successfully.
Nov 05 03:43:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-a185cf35-4ae6-41ed-884d-0cd1b0ce88b2 req-e324fc73-c878-4623-9c13-0e1efafd96f2 tempest-TaggedAttachmentsTest-158282243 None] Deleting attachment 4d7f8a26-2828-4980-ad95-71ca23649925. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:43:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-8b908f06-f3c3-420f-a87f-4860ba532647 req-154664da-88c0-407e-a46b-701eadedb8e8 tempest-DeleteServersTestJSON-1338297834 None] Terminate volume connection completed successfully.
Nov 05 03:43:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-8b908f06-f3c3-420f-a87f-4860ba532647 req-154664da-88c0-407e-a46b-701eadedb8e8 tempest-DeleteServersTestJSON-1338297834 None] Deleting attachment b72bf91a-587f-40b5-b5d7-057337a0640d. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:43:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Acquiring lock "cinder-949a045f-1539-4864-bd52-ee1ca58cf51b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Lock "cinder-949a045f-1539-4864-bd52-ee1ca58cf51b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Acquiring lock "cinder-quobyte-949a045f-1539-4864-bd52-ee1ca58cf51b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Lock "cinder-quobyte-949a045f-1539-4864-bd52-ee1ca58cf51b" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18605f5-31b7-4cdc-be58-e8d0fa1ab7fe]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:10 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b
Nov 05 03:43:10 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:10 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b" returned: 0 in 0.493s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:10 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:43:10 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:10 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b
Nov 05 03:43:10 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:10 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.323s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:10 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-949a045f-1539-4864-bd52-ee1ca58cf51b" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Lock "cinder-quobyte-949a045f-1539-4864-bd52-ee1ca58cf51b" released by "delete_volume" :: held 0.893s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Created reservations ['18a699d2-cb1f-48e8-8794-f990b2654729', 'a22e093c-a59f-4a1e-8574-9ef80f2ce29b', '887575ac-f171-4259-85d8-ef0e4cc6a8e7', '6e1d5c2d-a627-4493-949a-df75454a2f12'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:11 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:43:11 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:11 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Deleted volume successfully.
Nov 05 03:43:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51573f8a-4fe0-418e-9dc6-c8b32faca10e tempest-DeleteServersTestJSON-1338297834 None] Lock "cinder-949a045f-1539-4864-bd52-ee1ca58cf51b-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:21 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=40,cinder:SELECT=43,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:43:21 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=15,cinder:SELECT=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:43:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Acquiring lock "cinder-1df68777-624a-4ec4-824a-523898df7719-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Lock "cinder-1df68777-624a-4ec4-824a-523898df7719-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Acquiring lock "cinder-quobyte-1df68777-624a-4ec4-824a-523898df7719" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Lock "cinder-quobyte-1df68777-624a-4ec4-824a-523898df7719" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7b4c9c-266b-4219-a1c6-6eb1b13bec1b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:25 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719
Nov 05 03:43:25 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:25 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719" returned: 0 in 0.579s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:25 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719
Nov 05 03:43:25 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:25 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1df68777-624a-4ec4-824a-523898df7719" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Lock "cinder-quobyte-1df68777-624a-4ec4-824a-523898df7719" released by "delete_volume" :: held 1.033s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Created reservations ['0b428e43-accf-4c45-87c2-5323e2e4b41d', '5de7c8a9-21b0-428b-941d-24ef3667e7db', '3623c9aa-b8d1-425d-bf8c-2a0e36a0ef11', 'd2c14760-0254-4e71-84b2-f8adff64e4cb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:26 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:43:26 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:26 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Deleted volume successfully.
Nov 05 03:43:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-91124b04-c268-437b-918f-20b162c3fe1f tempest-TaggedAttachmentsTest-158282243 None] Lock "cinder-1df68777-624a-4ec4-824a-523898df7719-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:36 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:43:36 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Flow 'volume_create_manager' (d179251a-0735-45f8-ade1-69efdd48a809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7591c708-9e30-487c-8f8d-5b545940fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7591c708-9e30-487c-8f8d-5b545940fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1962924945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67414139-1fdc-46c0-889e-4c0dc1d76da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4067b931562d4c17b3d51d07569fbdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:05Z,use_quota=True,user_id='f6e70aacff5b427ea1434638ff9d6271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64460d30-9e86-4404-b172-453a526179ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64460d30-9e86-4404-b172-453a526179ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7e8940-650a-4dae-9a6a-284950b1ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7e8940-650a-4dae-9a6a-284950b1ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67414139-1fdc-46c0-889e-4c0dc1d76da9', 'volume_name': 'volume-67414139-1fdc-46c0-889e-4c0dc1d76da9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478e1f81-cca5-4696-80f5-58b420281203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478e1f81-cca5-4696-80f5-58b420281203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0443916e-ce29-4dd3-9fb4-c32e4528df0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Volume 67414139-1fdc-46c0-889e-4c0dc1d76da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67414139-1fdc-46c0-889e-4c0dc1d76da9', 'volume_size': 1}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1962924945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67414139-1fdc-46c0-889e-4c0dc1d76da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4067b931562d4c17b3d51d07569fbdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:05Z,use_quota=True,user_id='f6e70aacff5b427ea1434638ff9d6271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Creating volume 67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:44:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:05 devstack sudo[89784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 1073741824
Nov 05 03:44:05 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:06 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 1073741824" returned: 0 in 1.460s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:06 devstack sudo[89792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9
Nov 05 03:44:06 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:07 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9" returned: 0 in 0.706s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0443916e-ce29-4dd3-9fb4-c32e4528df0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67414139-1fdc-46c0-889e-4c0dc1d76da9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ce2c7e-6d83-4181-960a-fd46551db574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Volume volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 (67414139-1fdc-46c0-889e-4c0dc1d76da9): created successfully
Nov 05 03:44:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ce2c7e-6d83-4181-960a-fd46551db574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Flow 'volume_create_manager' (d179251a-0735-45f8-ade1-69efdd48a809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7dc7f5cf-25cc-4ee1-bd32-ea2c298b8964 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Created volume successfully.
Nov 05 03:44:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Creating offline snapshot 457b555c-3113-44ad-9d4c-08011ee53195 of volume 67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:44:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[590249e8-0fec-4aff-9602-cc5004aade69]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:09 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9
Nov 05 03:44:09 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:10 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9" returned: 0 in 1.161s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:10 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 1G
Nov 05 03:44:10 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:10 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:44:10 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:11 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:11 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 1G" returned: 0 in 1.090s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 1.073s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:44:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 8 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:44:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:44:11 devstack sudo[89849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195
Nov 05 03:44:11 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:12 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195" returned: 0 in 0.646s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:12 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 is being set with open permissions: ugo+rw
Nov 05 03:44:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:12 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195
Nov 05 03:44:12 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:12 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:13 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.info
Nov 05 03:44:13 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:13 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.info" returned: 0 in 0.633s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:13 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.info is being set with open permissions: ugo+rw
Nov 05 03:44:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:13 devstack sudo[89911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.info
Nov 05 03:44:13 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:14 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.info" returned: 0 in 0.535s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.920s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-21a84a0e-eaef-44dc-b378-14eebcc3bd9f tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Create snapshot completed successfully
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "cinder-457b555c-3113-44ad-9d4c-08011ee53195-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-457b555c-3113-44ad-9d4c-08011ee53195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "cinder-quobyte-67414139-1fdc-46c0-889e-4c0dc1d76da9" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-quobyte-67414139-1fdc-46c0-889e-4c0dc1d76da9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "cinder-quobyte-457b555c-3113-44ad-9d4c-08011ee53195" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-quobyte-457b555c-3113-44ad-9d4c-08011ee53195" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Deleting offline snapshot 457b555c-3113-44ad-9d4c-08011ee53195 of volume 67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] snapshot_file for this snap is: volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c624a-31e0-4e1f-b392-b8950e241941]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:15 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195
Nov 05 03:44:15 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:16 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195" returned: 0 in 0.739s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67414139-1fdc-46c0-889e-4c0dc1d76da9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:44:16 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a335a65e-5c1f-4137-9edf-300a7ec03ba3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:16 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9
Nov 05 03:44:16 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:16 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9" returned: 0 in 0.581s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:16 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195
Nov 05 03:44:16 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Flow 'volume_create_manager' (0db968ea-c75f-456e-af06-f0afaf7260ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398a3f8c-76a3-4172-b89e-dc529906d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398a3f8c-76a3-4172-b89e-dc529906d862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-356349002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749c38b7-0903-415b-9ace-b31ebba506fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69312c8b10407a95349a5270c0b5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:17Z,use_quota=True,user_id='7f8f0f74cb254283be92c66b890f387b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c37600-d49b-4b4c-b58d-f11e7d4d1596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c37600-d49b-4b4c-b58d-f11e7d4d1596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d3b5f9-e7cb-4566-9310-8a80859125df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d3b5f9-e7cb-4566-9310-8a80859125df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '749c38b7-0903-415b-9ace-b31ebba506fd', 'volume_name': 'volume-749c38b7-0903-415b-9ace-b31ebba506fd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:17 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc4488f-356a-4345-b643-7a2029da64e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc4488f-356a-4345-b643-7a2029da64e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433a6ce-a6ae-4477-8adf-41d858cc4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Volume 749c38b7-0903-415b-9ace-b31ebba506fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-749c38b7-0903-415b-9ace-b31ebba506fd', 'volume_size': 1}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-356349002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749c38b7-0903-415b-9ace-b31ebba506fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69312c8b10407a95349a5270c0b5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:17Z,use_quota=True,user_id='7f8f0f74cb254283be92c66b890f387b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Creating volume 749c38b7-0903-415b-9ace-b31ebba506fd {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195" returned: 0 in 0.919s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:17 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195
Nov 05 03:44:17 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:17 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd 1073741824
Nov 05 03:44:17 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:18 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9.457b555c-3113-44ad-9d4c-08011ee53195" returned: 0 in 0.535s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-quobyte-457b555c-3113-44ad-9d4c-08011ee53195" released by "_delete_snapshot" :: held 3.084s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-quobyte-67414139-1fdc-46c0-889e-4c0dc1d76da9" released by "delete_snapshot" :: held 3.180s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Created reservations ['316e379a-03d5-42df-b2a8-d7cacf3c604c', 'e1abb9da-ac73-4c75-9186-69a5e3423c16', '2164feeb-462e-406c-be84-ea2671da5dc7', '6b47c6a1-5b72-4d94-9858-37fcf4590ee4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Delete snapshot completed successfully.
Nov 05 03:44:18 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-978c00c1-693b-435a-96ec-d5463853a541 tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-457b555c-3113-44ad-9d4c-08011ee53195-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd 1073741824" returned: 0 in 1.103s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Flow 'volume_create_manager' (56dd7410-a67c-45c1-a166-9ff1affb0abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0752279-3646-4c40-9247-045fce12084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0752279-3646-4c40-9247-045fce12084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1958188070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74caac5-4676-42be-8bbe-aab600299974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd8430b9013498a9a3337f318517aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:19Z,use_quota=True,user_id='0bddc97c760a415e8294d858eda18b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2828b8bd-27f6-48a6-ad8e-9f8374d900ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2828b8bd-27f6-48a6-ad8e-9f8374d900ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d08ea63-850c-48af-8887-8d0a1e5f01f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d08ea63-850c-48af-8887-8d0a1e5f01f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74caac5-4676-42be-8bbe-aab600299974', 'volume_name': 'volume-a74caac5-4676-42be-8bbe-aab600299974', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fba10a-80b9-46b8-b1ae-14b9a7f64fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fba10a-80b9-46b8-b1ae-14b9a7f64fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5f9fd2-0762-4528-b320-60f4f6e7eb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Volume a74caac5-4676-42be-8bbe-aab600299974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74caac5-4676-42be-8bbe-aab600299974', 'volume_size': 1}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:18 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd
Nov 05 03:44:18 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:19 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1958188070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74caac5-4676-42be-8bbe-aab600299974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd8430b9013498a9a3337f318517aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:19Z,use_quota=True,user_id='0bddc97c760a415e8294d858eda18b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Creating volume a74caac5-4676-42be-8bbe-aab600299974 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:19 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433a6ce-a6ae-4477-8adf-41d858cc4d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749c38b7-0903-415b-9ace-b31ebba506fd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:19 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974 1073741824
Nov 05 03:44:19 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc3c259-6a0e-4872-83fe-e80ade92c4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Volume volume-749c38b7-0903-415b-9ace-b31ebba506fd (749c38b7-0903-415b-9ace-b31ebba506fd): created successfully
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc3c259-6a0e-4872-83fe-e80ade92c4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Flow 'volume_create_manager' (0db968ea-c75f-456e-af06-f0afaf7260ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5c23959f-9057-4b84-b394-893a1fc644b4 tempest-ServersNegativeTestJSON-1025181864 None] Created volume successfully.
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "cinder-67414139-1fdc-46c0-889e-4c0dc1d76da9-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-67414139-1fdc-46c0-889e-4c0dc1d76da9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "cinder-quobyte-67414139-1fdc-46c0-889e-4c0dc1d76da9" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-quobyte-67414139-1fdc-46c0-889e-4c0dc1d76da9" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bed3285-ca75-42a6-94ff-cdbeee3f62c8]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:20 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9
Nov 05 03:44:20 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:20 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974 1073741824" returned: 0 in 0.886s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:20 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974
Nov 05 03:44:20 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:20 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9" returned: 0 in 0.748s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:20 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9
Nov 05 03:44:20 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:21 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974" returned: 0 in 0.626s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5f9fd2-0762-4528-b320-60f4f6e7eb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74caac5-4676-42be-8bbe-aab600299974', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916dbe44-09c2-4371-a3ed-bbbff7dbb268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Volume volume-a74caac5-4676-42be-8bbe-aab600299974 (a74caac5-4676-42be-8bbe-aab600299974): created successfully
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916dbe44-09c2-4371-a3ed-bbbff7dbb268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Flow 'volume_create_manager' (56dd7410-a67c-45c1-a166-9ff1affb0abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0b6bf818-e8ae-4802-8177-c722719e83c4 tempest-ServerRescueNegativeTestJSON-1027409052 None] Created volume successfully.
Nov 05 03:44:21 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-67414139-1fdc-46c0-889e-4c0dc1d76da9" returned: 0 in 0.621s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-quobyte-67414139-1fdc-46c0-889e-4c0dc1d76da9" released by "delete_volume" :: held 1.478s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Created reservations ['35c82cf7-83cb-4da1-bf64-e3fbfe1e0dec', '2ee99185-2879-4fba-98e6-6081dc166fcd', '7d1f4a67-b553-4b53-9d8d-4ae55c82225e', 'fba0b71b-3b10-4459-afc5-6af5cd738df5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:21 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:44:21 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:22 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 1.096s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:22 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Deleted volume successfully.
Nov 05 03:44:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0765620a-5227-4534-8f74-e64e6dffdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1245565543 None] Lock "cinder-67414139-1fdc-46c0-889e-4c0dc1d76da9-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Flow 'volume_create_manager' (0f4a9d52-baef-48ea-8bea-95d489822dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecb3282-d795-432e-a592-d8e1c72f5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecb3282-d795-432e-a592-d8e1c72f5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-93030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1372d4ba-135c-49ec-b22b-c0b07206b123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69312c8b10407a95349a5270c0b5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:24Z,use_quota=True,user_id='7f8f0f74cb254283be92c66b890f387b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4469b5f2-9e31-4543-8a37-84def6f17e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4469b5f2-9e31-4543-8a37-84def6f17e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f67ba7-7de0-4d5a-80a9-bf1631c7738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f67ba7-7de0-4d5a-80a9-bf1631c7738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1372d4ba-135c-49ec-b22b-c0b07206b123', 'volume_name': 'volume-1372d4ba-135c-49ec-b22b-c0b07206b123', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaa4588-50ab-4251-891b-bcde5683b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaa4588-50ab-4251-891b-bcde5683b323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33d007-5d5b-4e7d-b1e1-2d16423fc4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Volume 1372d4ba-135c-49ec-b22b-c0b07206b123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1372d4ba-135c-49ec-b22b-c0b07206b123', 'volume_size': 1}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-93030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1372d4ba-135c-49ec-b22b-c0b07206b123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69312c8b10407a95349a5270c0b5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:24Z,use_quota=True,user_id='7f8f0f74cb254283be92c66b890f387b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Creating volume 1372d4ba-135c-49ec-b22b-c0b07206b123 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:24 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:44:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:24 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123 1073741824
Nov 05 03:44:24 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:25 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123 1073741824" returned: 0 in 0.944s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:25 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123
Nov 05 03:44:25 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:25 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33d007-5d5b-4e7d-b1e1-2d16423fc4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1372d4ba-135c-49ec-b22b-c0b07206b123', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ccd03b-b49c-44cf-8705-a31afc257d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Volume volume-1372d4ba-135c-49ec-b22b-c0b07206b123 (1372d4ba-135c-49ec-b22b-c0b07206b123): created successfully
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ccd03b-b49c-44cf-8705-a31afc257d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Flow 'volume_create_manager' (0f4a9d52-baef-48ea-8bea-95d489822dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4f35f24a-a6f4-467f-80a1-7d754cbcc263 tempest-ServersNegativeTestJSON-1025181864 None] Created volume successfully.
Nov 05 03:44:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "cinder-1372d4ba-135c-49ec-b22b-c0b07206b123-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-1372d4ba-135c-49ec-b22b-c0b07206b123-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "cinder-quobyte-1372d4ba-135c-49ec-b22b-c0b07206b123" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-quobyte-1372d4ba-135c-49ec-b22b-c0b07206b123" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9680be7-0961-46cd-8e99-7fa01901e0ea]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:27 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123
Nov 05 03:44:27 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:28 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123" returned: 0 in 0.734s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:28 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123
Nov 05 03:44:28 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:29 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1372d4ba-135c-49ec-b22b-c0b07206b123" returned: 0 in 0.579s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-quobyte-1372d4ba-135c-49ec-b22b-c0b07206b123" released by "delete_volume" :: held 1.447s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Created reservations ['2af88c07-f14c-4ae9-857c-ce47420c900a', '6b2d2e8d-3216-43c9-92b6-17561820d958', '9c453cc3-66fa-4529-b267-1e828c89ab57', '4f9abb8d-8fd9-4583-a2ee-8e823633ab03'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:29 devstack sudo[90058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:44:29 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "cinder-749c38b7-0903-415b-9ace-b31ebba506fd-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:30 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-749c38b7-0903-415b-9ace-b31ebba506fd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.516s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Deleted volume successfully.
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e8dd30a-31db-4629-b02f-d9dc66e93e79 tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-1372d4ba-135c-49ec-b22b-c0b07206b123-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "cinder-quobyte-749c38b7-0903-415b-9ace-b31ebba506fd" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-quobyte-749c38b7-0903-415b-9ace-b31ebba506fd" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6857c7b2-b0ed-4236-a219-39ace1a06deb]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:30 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd
Nov 05 03:44:30 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:30 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd" returned: 0 in 0.654s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:31 devstack sudo[90067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd
Nov 05 03:44:31 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:31 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-749c38b7-0903-415b-9ace-b31ebba506fd" returned: 0 in 0.542s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-quobyte-749c38b7-0903-415b-9ace-b31ebba506fd" released by "delete_volume" :: held 1.321s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Created reservations ['b96dafb5-6c7b-48b3-8143-598f894d48ae', '8e269705-ea66-4048-a557-778969ab7ec3', '3a04e006-199b-4fae-a82e-72fa6d330d5d', '0daa89b8-8be8-4a1f-9a09-19351437d25c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:31 devstack sudo[90116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:44:31 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:32 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Deleted volume successfully.
Nov 05 03:44:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82bb74f1-9328-4aa0-b92a-1c13ff72428d tempest-ServersNegativeTestJSON-1025181864 None] Lock "cinder-749c38b7-0903-415b-9ace-b31ebba506fd-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Acquiring lock "cinder-a74caac5-4676-42be-8bbe-aab600299974-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "cinder-a74caac5-4676-42be-8bbe-aab600299974-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Acquiring lock "cinder-quobyte-a74caac5-4676-42be-8bbe-aab600299974" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "cinder-quobyte-a74caac5-4676-42be-8bbe-aab600299974" acquired by "delete_volume" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[121da236-0c49-440a-a26e-a1fd9e856af3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:37 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974
Nov 05 03:44:37 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:37 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974" returned: 0 in 1.016s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:37 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974
Nov 05 03:44:37 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:38 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a74caac5-4676-42be-8bbe-aab600299974" returned: 0 in 0.515s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "cinder-quobyte-a74caac5-4676-42be-8bbe-aab600299974" released by "delete_volume" :: held 1.708s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Created reservations ['2d129a1e-d2f4-4ce4-9d9d-8b150db41253', '6a850730-0a46-4906-8d58-a1682473f78f', '0ce321bc-3d2e-4e55-873f-9e786c412d3a', '8e56a706-8123-489a-ae82-8a551004599d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:38 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:44:38 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:39 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.764s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Deleted volume successfully.
Nov 05 03:44:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64cbbba9-c2e5-4070-b2a9-34f4c3bb5ea6 tempest-ServerRescueNegativeTestJSON-1027409052 None] Lock "cinder-a74caac5-4676-42be-8bbe-aab600299974-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:49 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=53,cinder:SELECT=32,cinder:DELETE=8,cinder:INSERT=13 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Flow 'volume_create_manager' (713b093a-4432-447d-b195-1ffb818b8e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d36a1b6-8139-4456-b7f4-55f2c7407235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d36a1b6-8139-4456-b7f4-55f2c7407235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-945648490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01479ebbf8a4f5b9fcfbc801ed0a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:53Z,use_quota=True,user_id='e53fd5411f6743e58a4a5e21cb15c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831003a2-44f4-4e44-a081-086a0326401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831003a2-44f4-4e44-a081-086a0326401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e7eb68-bb22-4500-a306-5cf81a83d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e7eb68-bb22-4500-a306-5cf81a83d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7', 'volume_name': 'volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87c69a7-b2dc-4487-9a42-8e22ec311dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87c69a7-b2dc-4487-9a42-8e22ec311dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991bdbb8-8203-4d20-9f1e-fd8ae98fc24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Volume 2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7', 'volume_size': 1}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-945648490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01479ebbf8a4f5b9fcfbc801ed0a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:53Z,use_quota=True,user_id='e53fd5411f6743e58a4a5e21cb15c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Creating volume 2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:53 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:53 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 1073741824
Nov 05 03:44:53 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:53 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 1073741824" returned: 0 in 0.729s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:54 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7
Nov 05 03:44:54 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:54 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991bdbb8-8203-4d20-9f1e-fd8ae98fc24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6cac37-57e3-48d1-a6c8-24263d599301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Volume volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 (2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7): created successfully
Nov 05 03:44:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6cac37-57e3-48d1-a6c8-24263d599301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Flow 'volume_create_manager' (713b093a-4432-447d-b195-1ffb818b8e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f6a0c61a-84ab-47ca-86ed-012d96c10e22 tempest-VolumesListAdminTestJSON-349186242 None] Created volume successfully.
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Flow 'volume_create_manager' (2b6e6b59-b0c6-4429-8ca2-1fd6438141df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26102188-b307-4f81-b642-594f1939512c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26102188-b307-4f81-b642-594f1939512c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1664677957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfeb16b1-fe57-4335-919b-988dc7fb15e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01479ebbf8a4f5b9fcfbc801ed0a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:56Z,use_quota=True,user_id='e53fd5411f6743e58a4a5e21cb15c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf2dc2b-8165-4a5e-b5a6-5251dc0c538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf2dc2b-8165-4a5e-b5a6-5251dc0c538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90ff579-5273-4825-882c-1eb046a780cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90ff579-5273-4825-882c-1eb046a780cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfeb16b1-fe57-4335-919b-988dc7fb15e4', 'volume_name': 'volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3742f6-dcee-4042-82bf-1eee39b0f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3742f6-dcee-4042-82bf-1eee39b0f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed3bd92-232a-4846-b8ba-dc41f82b10ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:56 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Volume dfeb16b1-fe57-4335-919b-988dc7fb15e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4', 'volume_size': 1}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1664677957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfeb16b1-fe57-4335-919b-988dc7fb15e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01479ebbf8a4f5b9fcfbc801ed0a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:56Z,use_quota=True,user_id='e53fd5411f6743e58a4a5e21cb15c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Creating volume dfeb16b1-fe57-4335-919b-988dc7fb15e4 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:56 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:56 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4 1073741824
Nov 05 03:44:56 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:56 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4 1073741824" returned: 0 in 0.583s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=49,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:44:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:56 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4
Nov 05 03:44:56 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:57 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed3bd92-232a-4846-b8ba-dc41f82b10ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1026d362-f377-4c8f-a26e-8d61aa9c7392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Volume volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4 (dfeb16b1-fe57-4335-919b-988dc7fb15e4): created successfully
Nov 05 03:44:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1026d362-f377-4c8f-a26e-8d61aa9c7392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Flow 'volume_create_manager' (2b6e6b59-b0c6-4429-8ca2-1fd6438141df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bb883831-f791-4523-b636-2292e69d4db1 tempest-VolumesListAdminTestJSON-349186242 None] Created volume successfully.
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Flow 'volume_create_manager' (65c94f96-efaf-458f-a556-7fe1a7bbef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d5c42b-f09e-459e-aae3-93c5aabd11f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d5c42b-f09e-459e-aae3-93c5aabd11f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-626790513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2cc30a-a667-41b5-8fac-fe0609f6c04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01479ebbf8a4f5b9fcfbc801ed0a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:59Z,use_quota=True,user_id='e53fd5411f6743e58a4a5e21cb15c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e7253-bb54-481b-ac6b-f9922fac9866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e7253-bb54-481b-ac6b-f9922fac9866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eff6d5-9774-424f-b219-4d8e55b7a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eff6d5-9774-424f-b219-4d8e55b7a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2cc30a-a667-41b5-8fac-fe0609f6c04e', 'volume_name': 'volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad9292d-b817-492a-bbc6-7c39225db979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad9292d-b817-492a-bbc6-7c39225db979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7aa745-e263-47fa-bd16-82dc5c28abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Volume 9a2cc30a-a667-41b5-8fac-fe0609f6c04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e', 'volume_size': 1}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-626790513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2cc30a-a667-41b5-8fac-fe0609f6c04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01479ebbf8a4f5b9fcfbc801ed0a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:59Z,use_quota=True,user_id='e53fd5411f6743e58a4a5e21cb15c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Creating volume 9a2cc30a-a667-41b5-8fac-fe0609f6c04e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:44:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:59 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e 1073741824
Nov 05 03:44:59 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:00 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e 1073741824" returned: 0 in 0.666s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:00 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e
Nov 05 03:45:00 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:00 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7aa745-e263-47fa-bd16-82dc5c28abd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f2aac2-c81b-4d4b-ace9-1157d5b68887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Volume volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e (9a2cc30a-a667-41b5-8fac-fe0609f6c04e): created successfully
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f2aac2-c81b-4d4b-ace9-1157d5b68887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Flow 'volume_create_manager' (65c94f96-efaf-458f-a556-7fe1a7bbef6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-033a1abb-d7f2-49a5-8954-9be57541e18c tempest-VolumesListAdminTestJSON-349186242 None] Created volume successfully.
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Flow 'volume_create_manager' (a263e675-2126-46e5-b70f-84a399afcd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dffca94-ba94-446e-a6f0-51ca1363c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dffca94-ba94-446e-a6f0-51ca1363c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b595780a9b914d9f933e19d49b05d2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:02Z,use_quota=True,user_id='4b4d8b16592b4d8e9457c430101f624f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc32ee8-2174-42b7-88de-9b879fbcc541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc32ee8-2174-42b7-88de-9b879fbcc541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bca245d-34b8-493c-86c1-1c3fbf64c2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bca245d-34b8-493c-86c1-1c3fbf64c2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9', 'volume_name': 'volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4154288c-8380-4647-95cf-96cea11e86f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4154288c-8380-4647-95cf-96cea11e86f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfec727-8161-46aa-b3fd-893db6db8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Volume a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9', 'volume_size': 1}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b595780a9b914d9f933e19d49b05d2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:02Z,use_quota=True,user_id='4b4d8b16592b4d8e9457c430101f624f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Creating volume a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:45:02 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:45:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:02 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 1073741824
Nov 05 03:45:02 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:03 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 1073741824" returned: 0 in 0.671s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:03 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9
Nov 05 03:45:03 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:03 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfec727-8161-46aa-b3fd-893db6db8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b85fbe-df76-475d-9a08-4ee35b65abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Volume volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 (a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9): created successfully
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b85fbe-df76-475d-9a08-4ee35b65abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Flow 'volume_create_manager' (a263e675-2126-46e5-b70f-84a399afcd69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-57f45af8-9065-4d62-b78c-b5d71d3bfb06 tempest-VolumesListAdminTestJSON-237606411 None] Created volume successfully.
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Acquiring lock "cinder-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Lock "cinder-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Acquiring lock "cinder-quobyte-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Lock "cinder-quobyte-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2a720-6d5e-49c3-9084-32141971d677]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "cinder-9a2cc30a-a667-41b5-8fac-fe0609f6c04e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-9a2cc30a-a667-41b5-8fac-fe0609f6c04e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "cinder-quobyte-9a2cc30a-a667-41b5-8fac-fe0609f6c04e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-quobyte-9a2cc30a-a667-41b5-8fac-fe0609f6c04e" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[356fca60-bc36-439f-a950-51192acbb678]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:04 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9
Nov 05 03:45:04 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:05 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e
Nov 05 03:45:05 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:05 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9" returned: 0 in 0.804s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:05 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9
Nov 05 03:45:05 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:05 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e" returned: 0 in 0.743s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:05 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e
Nov 05 03:45:05 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:05 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9" returned: 0 in 0.462s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Lock "cinder-quobyte-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9" released by "delete_volume" :: held 1.353s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:06 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9a2cc30a-a667-41b5-8fac-fe0609f6c04e" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-quobyte-9a2cc30a-a667-41b5-8fac-fe0609f6c04e" released by "delete_volume" :: held 1.230s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Created reservations ['f5e0ca54-ec9b-461e-a53a-049d61671143', '47845c1e-91b0-4cec-9d36-d36b5b8803e1', 'd9dd30b9-86dd-49ba-ba28-d5a184868de7', '9486542a-0f0b-4ec3-9d6a-1642b8519f95'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Created reservations ['a1d2ba20-6368-4439-8150-ea9a56212e87', '7bb377c5-a73c-40d0-81eb-6004318c91ee', '8cd5da5e-316b-45dd-93cc-65e9e2febacd', '18b5dd24-eccb-46a1-9c90-c819f24249d3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:06 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:45:06 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:06 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:45:06 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:06 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Deleted volume successfully.
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bc297601-e733-48ca-8e3b-1cd5733efaaa tempest-VolumesListAdminTestJSON-237606411 None] Lock "cinder-a539e9e5-bcb0-48e8-b84b-96a1d05dc8f9-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:06 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Deleted volume successfully.
Nov 05 03:45:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82c3ddf-d13a-418a-bb35-291bbd69e440 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-9a2cc30a-a667-41b5-8fac-fe0609f6c04e-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "cinder-dfeb16b1-fe57-4335-919b-988dc7fb15e4-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-dfeb16b1-fe57-4335-919b-988dc7fb15e4-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "cinder-quobyte-dfeb16b1-fe57-4335-919b-988dc7fb15e4" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-quobyte-dfeb16b1-fe57-4335-919b-988dc7fb15e4" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2346c-5b79-4dff-a749-2beaf2e75694]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:07 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4
Nov 05 03:45:07 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:07 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:07 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4
Nov 05 03:45:07 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:08 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dfeb16b1-fe57-4335-919b-988dc7fb15e4" returned: 0 in 0.266s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-quobyte-dfeb16b1-fe57-4335-919b-988dc7fb15e4" released by "delete_volume" :: held 0.748s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Created reservations ['cb5102f2-fcb8-4992-8880-0c6e614c7b27', '68eaea73-a370-4c1d-baff-13cf306f6e9e', '6ae404b3-7ac9-4537-85d0-46b975165bb8', 'c4e21c6c-a2a2-4be8-a15c-aaba09d67f39'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:08 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:45:08 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "cinder-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "cinder-quobyte-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-quobyte-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:08 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Deleted volume successfully.
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75804d4-d38e-4c84-be54-50203e2cae62]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94338caa-eed9-4456-a582-a44bcf1f6e81 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-dfeb16b1-fe57-4335-919b-988dc7fb15e4-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:08 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7
Nov 05 03:45:08 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:09 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7" returned: 0 in 0.589s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:09 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7
Nov 05 03:45:09 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:09 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7" returned: 0 in 0.503s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-quobyte-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7" released by "delete_volume" :: held 1.189s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Created reservations ['3b7013b1-d15d-4143-9d75-dd45d9efbf71', '502a19e8-28c4-4d39-b4e0-b9a6a2a527b1', '5ff2a195-006b-4a9d-8128-50657dc9b1ca', 'bf392f3d-aec1-4623-b5ed-e02d058f03ee'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:10 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:45:10 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:10 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:45:10 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:10 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.551s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Deleted volume successfully.
Nov 05 03:45:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4f8c0037-dfda-43a4-8012-9db4c87b54f3 tempest-VolumesListAdminTestJSON-349186242 None] Lock "cinder-2c7f3029-2dca-4ac6-b3bb-94dbb1cd60f7-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:11 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.425s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:45:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 8 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:45:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:45:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Flow 'volume_create_manager' (6157f3af-2ba1-4528-a883-f25605f2f975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7ba797-2787-4dbe-bf8a-b1dfa1fa414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7ba797-2787-4dbe-bf8a-b1dfa1fa414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1569304694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c296aabe-4e67-4402-96e1-9098aa6332d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55935055c44d4f51b4629a75be4d3b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:16Z,use_quota=True,user_id='26b3d33dd924447cbc02febb80f7b448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd27e08-2eb9-4200-b636-070c2cd55484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd27e08-2eb9-4200-b636-070c2cd55484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c7dde1-17a0-4318-a417-47fd709d608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c7dde1-17a0-4318-a417-47fd709d608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c296aabe-4e67-4402-96e1-9098aa6332d9', 'volume_name': 'volume-c296aabe-4e67-4402-96e1-9098aa6332d9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3532429b-9b88-4413-b2e2-6e6034dfe708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3532429b-9b88-4413-b2e2-6e6034dfe708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df7c2ea-bdf3-4243-bdad-2582abce6eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Volume c296aabe-4e67-4402-96e1-9098aa6332d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c296aabe-4e67-4402-96e1-9098aa6332d9', 'volume_size': 1}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1569304694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c296aabe-4e67-4402-96e1-9098aa6332d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55935055c44d4f51b4629a75be4d3b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:16Z,use_quota=True,user_id='26b3d33dd924447cbc02febb80f7b448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Creating volume c296aabe-4e67-4402-96e1-9098aa6332d9 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:45:16 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:16 devstack sudo[90463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9 1073741824
Nov 05 03:45:16 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:16 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9 1073741824" returned: 0 in 0.810s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:17 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9
Nov 05 03:45:17 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:17 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9" returned: 0 in 0.331s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:45:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df7c2ea-bdf3-4243-bdad-2582abce6eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c296aabe-4e67-4402-96e1-9098aa6332d9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a551d8d7-a923-4492-870f-e4b809157df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Volume volume-c296aabe-4e67-4402-96e1-9098aa6332d9 (c296aabe-4e67-4402-96e1-9098aa6332d9): created successfully
Nov 05 03:45:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a551d8d7-a923-4492-870f-e4b809157df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Flow 'volume_create_manager' (6157f3af-2ba1-4528-a883-f25605f2f975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d78d73db-d3d5-42d8-a1eb-137348c53217 tempest-ServerActionsTestOtherA-1465707758 None] Created volume successfully.
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Flow 'volume_create_manager' (7668815e-0a38-42f9-b5a4-889801aff4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6890f9-b282-40f2-ad58-f52669114fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6890f9-b282-40f2-ad58-f52669114fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1629962996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b428f62-2417-455d-8948-e6ae3180cabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6541c87ba93e493ab95460dce772c2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:26Z,use_quota=True,user_id='7ff01e02aff54f2fab6d75dbca9976b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6602ffcd-15f8-4f68-934d-ba52e876e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6602ffcd-15f8-4f68-934d-ba52e876e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2497e8f0-29c9-4444-a153-f7db386dc53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2497e8f0-29c9-4444-a153-f7db386dc53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b428f62-2417-455d-8948-e6ae3180cabc', 'volume_name': 'volume-2b428f62-2417-455d-8948-e6ae3180cabc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c028b54-3f81-4a48-bd6d-f2252976e903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c028b54-3f81-4a48-bd6d-f2252976e903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5a5085-3d05-4863-9811-5efc7a5ec64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Volume 2b428f62-2417-455d-8948-e6ae3180cabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b428f62-2417-455d-8948-e6ae3180cabc', 'volume_size': 1}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1629962996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b428f62-2417-455d-8948-e6ae3180cabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6541c87ba93e493ab95460dce772c2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:26Z,use_quota=True,user_id='7ff01e02aff54f2fab6d75dbca9976b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Creating volume 2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:45:26 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:45:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:26 devstack sudo[90541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc 1073741824
Nov 05 03:45:26 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:27 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc 1073741824" returned: 0 in 0.715s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:27 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc
Nov 05 03:45:27 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:27 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5a5085-3d05-4863-9811-5efc7a5ec64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b428f62-2417-455d-8948-e6ae3180cabc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc9f28-7bab-469b-8e41-4d3a7b862da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Volume volume-2b428f62-2417-455d-8948-e6ae3180cabc (2b428f62-2417-455d-8948-e6ae3180cabc): created successfully
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc9f28-7bab-469b-8e41-4d3a7b862da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Flow 'volume_create_manager' (7668815e-0a38-42f9-b5a4-889801aff4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-45b556eb-59e1-4fb9-ad42-fb5dd7c27fc2 tempest-VolumesDeleteCascade-544332110 None] Created volume successfully.
Nov 05 03:45:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Creating offline snapshot d365f554-f7f0-4bd4-883f-937028582fcb of volume 2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:45:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[929908e5-ffeb-4d4b-a3b8-516d2af543a9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:29 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc
Nov 05 03:45:29 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:30 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc" returned: 0 in 0.865s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:30 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb 1G
Nov 05 03:45:30 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:31 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb 1G" returned: 0 in 1.017s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b428f62-2417-455d-8948-e6ae3180cabc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:31 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b428f62-2417-455d-8948-e6ae3180cabc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb
Nov 05 03:45:31 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:31 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b428f62-2417-455d-8948-e6ae3180cabc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb" returned: 0 in 0.496s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:31 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb is being set with open permissions: ugo+rw
Nov 05 03:45:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:31 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb
Nov 05 03:45:31 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:32 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb" returned: 0 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:32 devstack sudo[90719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.info
Nov 05 03:45:32 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:32 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.info" returned: 0 in 0.563s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:32 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.info is being set with open permissions: ugo+rw
Nov 05 03:45:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:32 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.info
Nov 05 03:45:32 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:33 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.info" returned: 0 in 0.671s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.587s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ee4039fc-a226-4ac5-81d5-9417ff463704 tempest-VolumesDeleteCascade-544332110 None] Create snapshot completed successfully
Nov 05 03:45:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Creating offline snapshot 44225328-141c-4678-aafd-ffef03c6eab7 of volume 2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:45:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ab95f1-c390-4f61-81d3-a34b66b1ffa6]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:35 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb
Nov 05 03:45:35 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:36 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb" returned: 0 in 0.737s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b428f62-2417-455d-8948-e6ae3180cabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:45:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:36 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 1G
Nov 05 03:45:36 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:37 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 1G" returned: 0 in 1.571s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:37 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7
Nov 05 03:45:37 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:38 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7" returned: 0 in 0.811s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:38 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 is being set with open permissions: ugo+rw
Nov 05 03:45:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:38 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7
Nov 05 03:45:38 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:38 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7" returned: 0 in 0.496s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b70df75d-4a21-4cbc-ae72-fd27285f4090 tempest-VolumesDeleteCascade-544332110 None] Create snapshot completed successfully
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-2b428f62-2417-455d-8948-e6ae3180cabc-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-2b428f62-2417-455d-8948-e6ae3180cabc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Performing cascade delete. {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-44225328-141c-4678-aafd-ffef03c6eab7-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-44225328-141c-4678-aafd-ffef03c6eab7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-44225328-141c-4678-aafd-ffef03c6eab7" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-44225328-141c-4678-aafd-ffef03c6eab7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Deleting offline snapshot 44225328-141c-4678-aafd-ffef03c6eab7 of volume 2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] snapshot_file for this snap is: volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ce3de-6ef6-4678-973f-3d63a837912a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:40 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7
Nov 05 03:45:40 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:40 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7" returned: 0 in 0.837s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b428f62-2417-455d-8948-e6ae3180cabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:45:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac450ba-cec2-42dd-b449-f21f42ee9bb2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:41 devstack sudo[90842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb
Nov 05 03:45:41 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:41 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb" returned: 0 in 0.848s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b428f62-2417-455d-8948-e6ae3180cabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:45:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:41 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7
Nov 05 03:45:41 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:42 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7" returned: 0 in 0.922s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:42 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7
Nov 05 03:45:42 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:43 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.44225328-141c-4678-aafd-ffef03c6eab7" returned: 0 in 0.723s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-44225328-141c-4678-aafd-ffef03c6eab7" released by "_delete_snapshot" :: held 3.571s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" released by "delete_snapshot" :: held 3.603s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Created reservations ['9c93fd13-fab5-411b-b121-decfa8d3b8a9', 'f156d449-d068-42dd-86da-dec29bcdb8ad', '0f098a18-15ab-4677-832d-be077a097331', '64be222c-009e-4297-9dbb-75488e963cb5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Delete snapshot completed successfully.
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-44225328-141c-4678-aafd-ffef03c6eab7-delete_snapshot" released by "delete_snapshot" :: held 3.961s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-d365f554-f7f0-4bd4-883f-937028582fcb-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-d365f554-f7f0-4bd4-883f-937028582fcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-d365f554-f7f0-4bd4-883f-937028582fcb" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-d365f554-f7f0-4bd4-883f-937028582fcb" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Deleting offline snapshot d365f554-f7f0-4bd4-883f-937028582fcb of volume 2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] snapshot_file for this snap is: volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[079bd1c3-31a9-413f-a672-b24dd0d815fa]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:44 devstack sudo[90864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb
Nov 05 03:45:44 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:44 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb" returned: 0 in 0.686s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b428f62-2417-455d-8948-e6ae3180cabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:45:44 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15aae0e-818f-4e9f-8174-72d55760c6e4]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:44 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc
Nov 05 03:45:44 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:45 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc" returned: 0 in 0.574s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:45 devstack sudo[90892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb
Nov 05 03:45:45 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:45 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb" returned: 0 in 0.573s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:45 devstack sudo[90900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb
Nov 05 03:45:45 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:46 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc.d365f554-f7f0-4bd4-883f-937028582fcb" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-d365f554-f7f0-4bd4-883f-937028582fcb" released by "_delete_snapshot" :: held 2.405s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" released by "delete_snapshot" :: held 2.468s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Created reservations ['28f6fc22-6ad4-494b-957b-5e9a064607de', '0e72d2b5-6ab6-44d2-9169-6d34f54ba145', '8ff4b89d-76d8-4960-b27a-b2cd1c05eab0', '0136c1ee-d852-4fef-b5ad-3f9d72ade2bb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Delete snapshot completed successfully.
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-d365f554-f7f0-4bd4-883f-937028582fcb-delete_snapshot" released by "delete_snapshot" :: held 2.862s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Snapshots deleted, issuing volume delete {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" acquired by "delete_volume" :: waited 0.054s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad21d85c-0927-405c-9104-26dce2bce7e5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:46 devstack sudo[90907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc
Nov 05 03:45:46 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:47 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc" returned: 0 in 0.551s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:47 devstack sudo[90942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc
Nov 05 03:45:47 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:47 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2b428f62-2417-455d-8948-e6ae3180cabc" returned: 0 in 0.360s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-2b428f62-2417-455d-8948-e6ae3180cabc" released by "delete_volume" :: held 1.041s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Created reservations ['3a1159cb-ea12-425e-92ba-71cada085080', 'dff5ddd3-d3c4-4581-ac47-52dd0e6f25b3', '8cc9bbc5-94c9-4901-bcf4-7daac9f5a664', 'fb1187e5-fd4b-49bd-a64f-6b5033fcbc5f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:48 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:45:48 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:48 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:48 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Deleted volume successfully.
Nov 05 03:45:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e60457e3-8f7a-4ee4-9324-217f737604d8 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-2b428f62-2417-455d-8948-e6ae3180cabc-delete_volume" released by "delete_volume" :: held 8.721s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=62,cinder:UPDATE=74,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Flow 'volume_create_manager' (2d9d9058-c938-45f0-8831-a22dcfa99392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3888a0d4-7f5b-48dc-9985-4af9b00aa8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3888a0d4-7f5b-48dc-9985-4af9b00aa8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1155543988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a91e6e-a868-48c2-89b4-1052275c73e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6541c87ba93e493ab95460dce772c2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:50Z,use_quota=True,user_id='7ff01e02aff54f2fab6d75dbca9976b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a79b3f7-1148-43ca-867d-ed1dfaac4093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a79b3f7-1148-43ca-867d-ed1dfaac4093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4eee0f-fa7d-4795-8d1d-35264885807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4eee0f-fa7d-4795-8d1d-35264885807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a91e6e-a868-48c2-89b4-1052275c73e3', 'volume_name': 'volume-c4a91e6e-a868-48c2-89b4-1052275c73e3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c971fe36-e604-4bc5-8d42-3bc2ba90437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c971fe36-e604-4bc5-8d42-3bc2ba90437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933f5a2f-dbb4-4732-a61c-99541fe8c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Volume c4a91e6e-a868-48c2-89b4-1052275c73e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a91e6e-a868-48c2-89b4-1052275c73e3', 'volume_size': 1}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1155543988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a91e6e-a868-48c2-89b4-1052275c73e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6541c87ba93e493ab95460dce772c2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:50Z,use_quota=True,user_id='7ff01e02aff54f2fab6d75dbca9976b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Creating volume c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:45:49 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:45:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:49 devstack sudo[90974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 1073741824
Nov 05 03:45:49 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:50 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 1073741824" returned: 0 in 0.533s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:50 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3
Nov 05 03:45:50 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:50 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933f5a2f-dbb4-4732-a61c-99541fe8c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a91e6e-a868-48c2-89b4-1052275c73e3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf965a9-429f-4e32-8620-73bfcebcd4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Volume volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 (c4a91e6e-a868-48c2-89b4-1052275c73e3): created successfully
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf965a9-429f-4e32-8620-73bfcebcd4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Flow 'volume_create_manager' (2d9d9058-c938-45f0-8831-a22dcfa99392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-560b6535-2f28-449f-bd46-9d0cbda7e575 tempest-VolumesDeleteCascade-544332110 None] Created volume successfully.
Nov 05 03:45:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Creating offline snapshot c906877f-c8c3-4913-9695-668bc603af08 of volume c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:45:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d00cfe-3ae0-41d2-b632-fa06c2e4740b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:52 devstack sudo[90983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3
Nov 05 03:45:52 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:52 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:52 devstack sudo[90988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 1G
Nov 05 03:45:52 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:52 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 1G" returned: 0 in 0.446s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:52 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08
Nov 05 03:45:52 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:53 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:53 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 is being set with open permissions: ugo+rw
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:53 devstack sudo[90998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08
Nov 05 03:45:53 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:53 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08" returned: 0 in 0.247s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:53 devstack sudo[91001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.info
Nov 05 03:45:53 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:53 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.info" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:53 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.info is being set with open permissions: ugo+rw
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:53 devstack sudo[91004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.info
Nov 05 03:45:53 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:53 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.info" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7af16e7b-0804-4323-b190-ccfcce245b15 tempest-VolumesDeleteCascade-544332110 None] Create snapshot completed successfully
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Flow 'volume_create_manager' (fd023afa-6eae-4f02-8ace-bc9c5b716d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f8476f-098e-4130-b7a3-38e5eb2347be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f8476f-098e-4130-b7a3-38e5eb2347be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2129707529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366f6a64-a6ec-41b8-92f2-1db97b980530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6541c87ba93e493ab95460dce772c2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c906877f-c8c3-4913-9695-668bc603af08,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:56Z,use_quota=True,user_id='7ff01e02aff54f2fab6d75dbca9976b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61417753-fb87-4588-b868-d1680da65676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61417753-fb87-4588-b868-d1680da65676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c32f7-4567-4eeb-a8a6-051c80e15b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c32f7-4567-4eeb-a8a6-051c80e15b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '366f6a64-a6ec-41b8-92f2-1db97b980530', 'volume_name': 'volume-366f6a64-a6ec-41b8-92f2-1db97b980530', 'volume_size': 1, 'snapshot_id': 'c906877f-c8c3-4913-9695-668bc603af08'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3708c79-a9f8-4b6a-af5e-9ecb9561ec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3708c79-a9f8-4b6a-af5e-9ecb9561ec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb49a7d-0595-4073-8a85-7458606682e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Volume 366f6a64-a6ec-41b8-92f2-1db97b980530: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-366f6a64-a6ec-41b8-92f2-1db97b980530', 'volume_size': 1, 'snapshot_id': 'c906877f-c8c3-4913-9695-668bc603af08'}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-c906877f-c8c3-4913-9695-668bc603af08-366f6a64-a6ec-41b8-92f2-1db97b980530" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c906877f-c8c3-4913-9695-668bc603af08-366f6a64-a6ec-41b8-92f2-1db97b980530" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Creating volume 366f6a64-a6ec-41b8-92f2-1db97b980530 from snapshot c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-366f6a64-a6ec-41b8-92f2-1db97b980530" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-366f6a64-a6ec-41b8-92f2-1db97b980530" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] snapshot: c906877f-c8c3-4913-9695-668bc603af08, volume: 366f6a64-a6ec-41b8-92f2-1db97b980530,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d404986-94d8-4a55-bec0-b06ea2a8e1ca]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:55 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08
Nov 05 03:45:55 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:56 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a91e6e-a868-48c2-89b4-1052275c73e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6868e1ac-2911-4f32-b573-eb2c3315d6d2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:56 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3
Nov 05 03:45:56 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:56 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:45:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:56 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530
Nov 05 03:45:56 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:59 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=70,cinder:DELETE=5,cinder:SELECT=59,cinder:INSERT=13 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Flow 'volume_create_manager' (3f842184-5974-43c2-abb2-637013dcfd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedf485a-1f79-4862-a4e3-c55ac3374947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedf485a-1f79-4862-a4e3-c55ac3374947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-654979811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcd60c7-ed17-419e-81f8-a84f7ead620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76e86e4adcd4a1596c8a7bd67a044e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:00Z,use_quota=True,user_id='e5360f36aa9d473fad13f2db1bf1f45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b5905c-1549-4e04-ac74-442968ae60ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b5905c-1549-4e04-ac74-442968ae60ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73c142f-352c-45ae-adc9-88140b407373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73c142f-352c-45ae-adc9-88140b407373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adcd60c7-ed17-419e-81f8-a84f7ead620a', 'volume_name': 'volume-adcd60c7-ed17-419e-81f8-a84f7ead620a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af701f7-5e7a-4957-8554-aeb6b45c2979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af701f7-5e7a-4957-8554-aeb6b45c2979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc397a64-522f-4281-a253-672c3e3273ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Volume adcd60c7-ed17-419e-81f8-a84f7ead620a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adcd60c7-ed17-419e-81f8-a84f7ead620a', 'volume_size': 1}
Nov 05 03:46:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f3b0ec94-0f04-4bb5-82fd-56ed560983aa req-f314c6e3-af7a-414e-97b5-eb82677dde43 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:04 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530" returned: 0 in 8.061s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:04 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:46:04 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Converted 1024.00 MB image at 127.02 MB/s
Nov 05 03:46:04 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530 is being set with open permissions: ugo+rw
Nov 05 03:46:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:04 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530
Nov 05 03:46:04 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:05 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-366f6a64-a6ec-41b8-92f2-1db97b980530" released by "_copy_volume_from_snapshot" :: held 9.246s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c906877f-c8c3-4913-9695-668bc603af08-366f6a64-a6ec-41b8-92f2-1db97b980530" released by "_create_volume_from_snapshot" :: held 9.313s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.329s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.842s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-654979811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcd60c7-ed17-419e-81f8-a84f7ead620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76e86e4adcd4a1596c8a7bd67a044e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:00Z,use_quota=True,user_id='e5360f36aa9d473fad13f2db1bf1f45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Creating volume adcd60c7-ed17-419e-81f8-a84f7ead620a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:05 devstack sudo[91077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a 1073741824
Nov 05 03:46:05 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb49a7d-0595-4073-8a85-7458606682e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366f6a64-a6ec-41b8-92f2-1db97b980530', 'volume_size': 1, 'snapshot_id': 'c906877f-c8c3-4913-9695-668bc603af08'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914af07b-3cf7-4cfa-9d7d-ab9cd169607d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Volume volume-366f6a64-a6ec-41b8-92f2-1db97b980530 (366f6a64-a6ec-41b8-92f2-1db97b980530): created successfully
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914af07b-3cf7-4cfa-9d7d-ab9cd169607d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Flow 'volume_create_manager' (fd023afa-6eae-4f02-8ace-bc9c5b716d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4b5d63dd-2fd4-4d76-aad5-c6485b62145f tempest-VolumesDeleteCascade-544332110 None] Created volume successfully.
Nov 05 03:46:05 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a 1073741824" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:05 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a
Nov 05 03:46:05 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:05 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f3b0ec94-0f04-4bb5-82fd-56ed560983aa req-f314c6e3-af7a-414e-97b5-eb82677dde43 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.371s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc397a64-522f-4281-a253-672c3e3273ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adcd60c7-ed17-419e-81f8-a84f7ead620a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c4b0df-4c9b-4155-a80b-47696eea3001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f3b0ec94-0f04-4bb5-82fd-56ed560983aa req-f314c6e3-af7a-414e-97b5-eb82677dde43 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.111s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Volume volume-adcd60c7-ed17-419e-81f8-a84f7ead620a (adcd60c7-ed17-419e-81f8-a84f7ead620a): created successfully
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c4b0df-4c9b-4155-a80b-47696eea3001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Flow 'volume_create_manager' (3f842184-5974-43c2-abb2-637013dcfd67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-c4a91e6e-a868-48c2-89b4-1052275c73e3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c22ae6d6-7335-4db0-a619-52a532b17473 tempest-AttachVolumeShelveTestJSON-2128549207 None] Created volume successfully.
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-f3b0ec94-0f04-4bb5-82fd-56ed560983aa req-f314c6e3-af7a-414e-97b5-eb82677dde43 tempest-ServerActionsTestOtherA-1465707758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-c296aabe-4e67-4402-96e1-9098aa6332d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c73aaf72-5fb5-4bf0-a370-aaf33ba4d5d2', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-c4a91e6e-a868-48c2-89b4-1052275c73e3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Flow 'volume_create_manager' (cd4fd9ab-3b13-46f2-b698-0f3633da276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c455da5-299c-4535-a6d8-6c3dbdbbbf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c455da5-299c-4535-a6d8-6c3dbdbbbf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-509738343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eacff4-320e-44c0-b392-519471ce7467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ccd832c08344bbb560bec09785e5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:06Z,use_quota=True,user_id='bb42643bf18d4f9981ac0fe9acb3d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef0e753-68cd-45bf-8466-7ce7a59155fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef0e753-68cd-45bf-8466-7ce7a59155fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2640baa8-68d7-4723-b0ca-6133bf711443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2640baa8-68d7-4723-b0ca-6133bf711443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eacff4-320e-44c0-b392-519471ce7467', 'volume_name': 'volume-d8eacff4-320e-44c0-b392-519471ce7467', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c9d81a-d5c1-4b26-928e-478180b5d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c9d81a-d5c1-4b26-928e-478180b5d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173145e4-ea8d-4c0e-8331-92c0152b2843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Volume d8eacff4-320e-44c0-b392-519471ce7467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eacff4-320e-44c0-b392-519471ce7467', 'volume_size': 1}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-509738343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eacff4-320e-44c0-b392-519471ce7467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ccd832c08344bbb560bec09785e5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:06Z,use_quota=True,user_id='bb42643bf18d4f9981ac0fe9acb3d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Creating volume d8eacff4-320e-44c0-b392-519471ce7467 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:06 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:06 devstack sudo[91088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467 1073741824
Nov 05 03:46:06 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Performing cascade delete. {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}}
Nov 05 03:46:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-f3b0ec94-0f04-4bb5-82fd-56ed560983aa req-f314c6e3-af7a-414e-97b5-eb82677dde43 tempest-ServerActionsTestOtherA-1465707758 None] attachment_update completed successfully.
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-c906877f-c8c3-4913-9695-668bc603af08-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-c906877f-c8c3-4913-9695-668bc603af08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-c4a91e6e-a868-48c2-89b4-1052275c73e3" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c4a91e6e-a868-48c2-89b4-1052275c73e3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-c906877f-c8c3-4913-9695-668bc603af08" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c906877f-c8c3-4913-9695-668bc603af08" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Deleting offline snapshot c906877f-c8c3-4913-9695-668bc603af08 of volume c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] snapshot_file for this snap is: volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd18c8-0460-489c-b423-dcde697e0d27]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:06 devstack sudo[91115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08
Nov 05 03:46:06 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:06 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467 1073741824" returned: 0 in 0.617s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:06 devstack sudo[91515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467
Nov 05 03:46:06 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:07 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08" returned: 0 in 0.615s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a91e6e-a868-48c2-89b4-1052275c73e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ea54f1-ee58-414f-881e-602484f84325]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:07 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:07 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3
Nov 05 03:46:07 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173145e4-ea8d-4c0e-8331-92c0152b2843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eacff4-320e-44c0-b392-519471ce7467', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecf30a2-d556-4745-830c-ac1a9fc37813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Volume volume-d8eacff4-320e-44c0-b392-519471ce7467 (d8eacff4-320e-44c0-b392-519471ce7467): created successfully
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecf30a2-d556-4745-830c-ac1a9fc37813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Flow 'volume_create_manager' (cd4fd9ab-3b13-46f2-b698-0f3633da276b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0bdb9a17-0afb-42aa-847d-3a9ac5dd9c9a tempest-AttachVolumeNegativeTest-256552439 None] Created volume successfully.
Nov 05 03:46:07 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3" returned: 0 in 0.666s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:07 devstack sudo[91526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08
Nov 05 03:46:07 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:08 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:08 devstack sudo[91531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08
Nov 05 03:46:08 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:08 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3.c906877f-c8c3-4913-9695-668bc603af08" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c906877f-c8c3-4913-9695-668bc603af08" released by "_delete_snapshot" :: held 2.271s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c4a91e6e-a868-48c2-89b4-1052275c73e3" released by "delete_snapshot" :: held 2.321s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Created reservations ['3ef43923-72fe-4441-aaf9-ebd8eabb4554', '42ea07e5-b4c6-455c-942d-dd9064997000', '80f07c2f-53ab-49e3-b3c7-087a63ead24c', '271e610f-76ee-43a4-98f6-d35097077819'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Delete snapshot completed successfully.
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-c906877f-c8c3-4913-9695-668bc603af08-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Snapshots deleted, issuing volume delete {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}}
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-c4a91e6e-a868-48c2-89b4-1052275c73e3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c4a91e6e-a868-48c2-89b4-1052275c73e3" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6d30d-cce9-4543-a795-b60deb48cd83]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:09 devstack sudo[91549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3
Nov 05 03:46:09 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:09 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3" returned: 0 in 0.643s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:09 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3
Nov 05 03:46:09 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-af2f70b8-48b7-497c-94a6-099df9dc0560 req-d173fd3c-238c-4d40-bbf9-6b9297d9f235 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-af2f70b8-48b7-497c-94a6-099df9dc0560 req-d173fd3c-238c-4d40-bbf9-6b9297d9f235 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-af2f70b8-48b7-497c-94a6-099df9dc0560 req-d173fd3c-238c-4d40-bbf9-6b9297d9f235 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-af2f70b8-48b7-497c-94a6-099df9dc0560 req-d173fd3c-238c-4d40-bbf9-6b9297d9f235 tempest-AttachVolumeNegativeTest-256552439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-d8eacff4-320e-44c0-b392-519471ce7467', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c5f891e-6297-4ec4-b0c0-461741424704', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:46:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-af2f70b8-48b7-497c-94a6-099df9dc0560 req-d173fd3c-238c-4d40-bbf9-6b9297d9f235 tempest-AttachVolumeNegativeTest-256552439 None] attachment_update completed successfully.
Nov 05 03:46:10 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c4a91e6e-a868-48c2-89b4-1052275c73e3" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-c4a91e6e-a868-48c2-89b4-1052275c73e3" released by "delete_volume" :: held 1.158s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Created reservations ['e466eeaf-d507-483c-9865-517a1888db76', 'fd23646e-004f-477d-8b9b-6a8773b72843', '04a552e8-0176-40c2-b428-78b6d63a8f61', '83f8a582-020e-4857-ab84-80cf4d93b258'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-84ae1692-bfa6-42c8-8208-579820b2be22 req-aeec45d0-a89e-454a-b1d0-12823655d72c tempest-ServerActionsTestOtherA-1465707758 None] Terminate volume connection completed successfully.
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-84ae1692-bfa6-42c8-8208-579820b2be22 req-aeec45d0-a89e-454a-b1d0-12823655d72c tempest-ServerActionsTestOtherA-1465707758 None] Deleting attachment c73aaf72-5fb5-4bf0-a370-aaf33ba4d5d2. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:10 devstack sudo[91583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:46:10 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:10 devstack sudo[91585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:46:10 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-366f6a64-a6ec-41b8-92f2-1db97b980530-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-366f6a64-a6ec-41b8-92f2-1db97b980530-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:11 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.758s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:11 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.651s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Deleted volume successfully.
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "cinder-quobyte-366f6a64-a6ec-41b8-92f2-1db97b980530" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e2b30fd-e15c-4810-81a9-6491800430c3 tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-c4a91e6e-a868-48c2-89b4-1052275c73e3-delete_volume" released by "delete_volume" :: held 5.255s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-366f6a64-a6ec-41b8-92f2-1db97b980530" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 9 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[af316672-ff87-4aea-ad2b-5d22abd619e0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:11 devstack sudo[91608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530
Nov 05 03:46:11 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-84ae1692-bfa6-42c8-8208-579820b2be22 req-c2c5b083-1f7c-4cb3-a2ab-6bc706e0b6fc tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-84ae1692-bfa6-42c8-8208-579820b2be22 req-c2c5b083-1f7c-4cb3-a2ab-6bc706e0b6fc tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-84ae1692-bfa6-42c8-8208-579820b2be22 req-c2c5b083-1f7c-4cb3-a2ab-6bc706e0b6fc tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:12 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530" returned: 0 in 0.773s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:12 devstack sudo[91624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530
Nov 05 03:46:12 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-84ae1692-bfa6-42c8-8208-579820b2be22 req-c2c5b083-1f7c-4cb3-a2ab-6bc706e0b6fc tempest-ServerActionsTestOtherA-1465707758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-c296aabe-4e67-4402-96e1-9098aa6332d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31e4ece0-8b97-4c5f-890b-e304ea4374ef', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:46:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-84ae1692-bfa6-42c8-8208-579820b2be22 req-c2c5b083-1f7c-4cb3-a2ab-6bc706e0b6fc tempest-ServerActionsTestOtherA-1465707758 None] attachment_update completed successfully.
Nov 05 03:46:12 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-366f6a64-a6ec-41b8-92f2-1db97b980530" returned: 0 in 0.623s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-quobyte-366f6a64-a6ec-41b8-92f2-1db97b980530" released by "delete_volume" :: held 1.500s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Created reservations ['64601bcf-6c0a-4352-9a32-46d30712afb4', 'c8909346-225c-4c3a-b886-4e5137597fd8', 'c2d30c0a-bc68-440f-94db-24fb75bd1175', '115eb4f3-0cab-4b6b-96cf-51ba4a6f888f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:13 devstack sudo[91631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:46:13 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:13 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Deleted volume successfully.
Nov 05 03:46:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9020f7dd-9403-45c4-9089-b1cdd1ad783d tempest-VolumesDeleteCascade-544332110 None] Lock "cinder-366f6a64-a6ec-41b8-92f2-1db97b980530-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Flow 'volume_create_manager' (3bd17426-0302-4cb6-9cee-33b6b5aeed43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c2123a-d091-4833-987c-d57959729e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c2123a-d091-4833-987c-d57959729e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-990400237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e86117-6b68-4d32-84d6-74b12660bf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6d227e503f43a5b497109f17bd79cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:22Z,use_quota=True,user_id='5644ff5359d248e6963f6f5960707fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011b72e4-a53b-4764-b9bd-d5e2b2bb2fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011b72e4-a53b-4764-b9bd-d5e2b2bb2fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db1d93-0ac9-4446-b3ed-c748df23a793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db1d93-0ac9-4446-b3ed-c748df23a793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e86117-6b68-4d32-84d6-74b12660bf30', 'volume_name': 'volume-45e86117-6b68-4d32-84d6-74b12660bf30', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a38739f-70a2-4984-a749-84627601b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a38739f-70a2-4984-a749-84627601b587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4709b65-8a09-4fbe-8737-ffd27e4148b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Volume 45e86117-6b68-4d32-84d6-74b12660bf30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e86117-6b68-4d32-84d6-74b12660bf30', 'volume_size': 1}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-990400237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e86117-6b68-4d32-84d6-74b12660bf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6d227e503f43a5b497109f17bd79cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:22Z,use_quota=True,user_id='5644ff5359d248e6963f6f5960707fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Creating volume 45e86117-6b68-4d32-84d6-74b12660bf30 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:46:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:22 devstack sudo[91740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30 1073741824
Nov 05 03:46:22 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-a63af6e8-48ae-4e14-a762-857ca5ea239c req-71bd9fd2-1f80-496b-a80a-08f8944ee30d tempest-AttachVolumeShelveTestJSON-2128549207 None] No connector for attachment 29574fd7-39d7-436c-a2f0-3fe3008798dd; skipping storage backend terminate_connection call. {{(pid=87401) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5033}}
Nov 05 03:46:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-a63af6e8-48ae-4e14-a762-857ca5ea239c req-71bd9fd2-1f80-496b-a80a-08f8944ee30d tempest-AttachVolumeShelveTestJSON-2128549207 None] Deleting attachment 29574fd7-39d7-436c-a2f0-3fe3008798dd. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:46:23 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30 1073741824" returned: 0 in 0.795s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:23 devstack sudo[91746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30
Nov 05 03:46:23 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:24 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4709b65-8a09-4fbe-8737-ffd27e4148b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e86117-6b68-4d32-84d6-74b12660bf30', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290becb7-631d-48bd-816f-aeefe8d9190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Volume volume-45e86117-6b68-4d32-84d6-74b12660bf30 (45e86117-6b68-4d32-84d6-74b12660bf30): created successfully
Nov 05 03:46:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290becb7-631d-48bd-816f-aeefe8d9190f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Flow 'volume_create_manager' (3bd17426-0302-4cb6-9cee-33b6b5aeed43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-27cc9bf9-88f0-467a-a14c-4cc7e405b648 tempest-VolumesMetadataTest-1840759064 None] Created volume successfully.
Nov 05 03:46:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Acquiring lock "cinder-45e86117-6b68-4d32-84d6-74b12660bf30-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Lock "cinder-45e86117-6b68-4d32-84d6-74b12660bf30-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Acquiring lock "cinder-quobyte-45e86117-6b68-4d32-84d6-74b12660bf30" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Lock "cinder-quobyte-45e86117-6b68-4d32-84d6-74b12660bf30" acquired by "delete_volume" :: waited 0.046s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[26078588-82b8-4c58-9aab-91ccfa3b7a12]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:28 devstack sudo[91821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30
Nov 05 03:46:28 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:28 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30" returned: 0 in 0.825s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:28 devstack sudo[91830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30
Nov 05 03:46:28 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:29 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45e86117-6b68-4d32-84d6-74b12660bf30" returned: 0 in 0.700s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Lock "cinder-quobyte-45e86117-6b68-4d32-84d6-74b12660bf30" released by "delete_volume" :: held 1.624s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Created reservations ['a0d08af8-eff4-44fa-a2b2-69eded623136', '2d569fee-ef3d-4a27-ad01-fc3fb40cf5fd', 'eb6080fb-d818-489c-ab8f-3c71fabbbbb5', '869f9ee3-3d6f-49cb-a7f5-02e8c48587de'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:29 devstack sudo[91834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:46:29 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:30 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.878s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Deleted volume successfully.
Nov 05 03:46:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8e4157ed-dfe8-4b8b-b550-0c27b0e63de2 tempest-VolumesMetadataTest-1840759064 None] Lock "cinder-45e86117-6b68-4d32-84d6-74b12660bf30-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Flow 'volume_create_manager' (c29045fd-91d1-4551-8390-6ff8eb964aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829a0ce1-bc1a-43bf-a4fd-d595b3639f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829a0ce1-bc1a-43bf-a4fd-d595b3639f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-744919155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96862063-5a8b-4cca-a025-670b93ab491f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee5c1736fe74a07b1b2ee8235d0df80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:38Z,use_quota=True,user_id='522558ad2af04beaa7c8805ed9ea5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fddacd-08e8-4616-925b-47a58ad58f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fddacd-08e8-4616-925b-47a58ad58f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123f6e4b-8ace-4b3a-ac90-5dc35a76ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123f6e4b-8ace-4b3a-ac90-5dc35a76ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96862063-5a8b-4cca-a025-670b93ab491f', 'volume_name': 'volume-96862063-5a8b-4cca-a025-670b93ab491f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cccc60-cb9e-4a84-bde4-dc81d7c9d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cccc60-cb9e-4a84-bde4-dc81d7c9d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86074a0-7e64-42ab-936a-b1567f0e4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Volume 96862063-5a8b-4cca-a025-670b93ab491f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96862063-5a8b-4cca-a025-670b93ab491f', 'volume_size': 1}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-744919155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96862063-5a8b-4cca-a025-670b93ab491f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee5c1736fe74a07b1b2ee8235d0df80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:38Z,use_quota=True,user_id='522558ad2af04beaa7c8805ed9ea5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Creating volume 96862063-5a8b-4cca-a025-670b93ab491f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:38 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:46:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:38 devstack sudo[91946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f 1073741824
Nov 05 03:46:38 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:39 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f 1073741824" returned: 0 in 1.014s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:39 devstack sudo[91983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f
Nov 05 03:46:39 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:40 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f" returned: 0 in 0.500s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86074a0-7e64-42ab-936a-b1567f0e4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96862063-5a8b-4cca-a025-670b93ab491f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19360f36-f885-49bb-b99a-f00b951def5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Volume volume-96862063-5a8b-4cca-a025-670b93ab491f (96862063-5a8b-4cca-a025-670b93ab491f): created successfully
Nov 05 03:46:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19360f36-f885-49bb-b99a-f00b951def5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Flow 'volume_create_manager' (c29045fd-91d1-4551-8390-6ff8eb964aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5d19dcad-9e9c-4af6-99af-b2a9001b7e9f tempest-VolumesTransfersTest-2140712187 None] Created volume successfully.
Nov 05 03:46:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-76e28844-19d8-4551-968b-ad99b29d04fa tempest-VolumesTransfersTest-663759996 None] Transfer volume completed successfully.
Nov 05 03:46:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-db139a34-1170-4731-bd5f-b6cdd2d5e4ed req-cb2d793f-2428-4184-9140-9ee6c33e7bb1 tempest-ServerActionsTestOtherA-1465707758 None] Terminate volume connection completed successfully.
Nov 05 03:46:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-db139a34-1170-4731-bd5f-b6cdd2d5e4ed req-cb2d793f-2428-4184-9140-9ee6c33e7bb1 tempest-ServerActionsTestOtherA-1465707758 None] Deleting attachment 31e4ece0-8b97-4c5f-890b-e304ea4374ef. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:46:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Acquiring lock "cinder-96862063-5a8b-4cca-a025-670b93ab491f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-96862063-5a8b-4cca-a025-670b93ab491f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Acquiring lock "cinder-quobyte-96862063-5a8b-4cca-a025-670b93ab491f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-quobyte-96862063-5a8b-4cca-a025-670b93ab491f" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5c0cd8-f00f-4bf8-b7bb-6c96b52cd916]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:43 devstack sudo[92062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f
Nov 05 03:46:43 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:44 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f" returned: 0 in 0.525s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:44 devstack sudo[92069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f
Nov 05 03:46:44 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:44 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-96862063-5a8b-4cca-a025-670b93ab491f" returned: 0 in 0.759s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-quobyte-96862063-5a8b-4cca-a025-670b93ab491f" released by "delete_volume" :: held 1.348s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:44 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Created reservations ['59ba691a-0d35-4ed7-b3a0-63e9b867c3cf', 'a7113e00-28d8-4388-8bfc-02d60a1d0ca1', '9ef4d361-6da5-4893-a590-63793cc263da', 'dc9ad8ee-3f9f-45e2-b1c3-eddd411f2532'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:45 devstack sudo[92095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:46:45 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:45 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.465s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Deleted volume successfully.
Nov 05 03:46:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ded98e-f49a-4cde-9aeb-409d3b73c197 tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-96862063-5a8b-4cca-a025-670b93ab491f-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Flow 'volume_create_manager' (1d59ebdf-e668-4d05-9487-686aa9dd5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6f2cd9-1372-47b1-9fd5-c3737426263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6f2cd9-1372-47b1-9fd5-c3737426263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-991473328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350f59e6-cb4a-4034-ad7f-669776dc14b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee5c1736fe74a07b1b2ee8235d0df80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:46Z,use_quota=True,user_id='522558ad2af04beaa7c8805ed9ea5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58769bf-9282-4847-916b-30d87b225077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58769bf-9282-4847-916b-30d87b225077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0213bdb6-bf78-44fb-8e8a-12d59ced7221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0213bdb6-bf78-44fb-8e8a-12d59ced7221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350f59e6-cb4a-4034-ad7f-669776dc14b0', 'volume_name': 'volume-350f59e6-cb4a-4034-ad7f-669776dc14b0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac446de-e816-41d0-b2e7-586a1b36d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac446de-e816-41d0-b2e7-586a1b36d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa45304-e33e-4128-af5d-1c83b86d04ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Volume 350f59e6-cb4a-4034-ad7f-669776dc14b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350f59e6-cb4a-4034-ad7f-669776dc14b0', 'volume_size': 1}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-991473328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350f59e6-cb4a-4034-ad7f-669776dc14b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee5c1736fe74a07b1b2ee8235d0df80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:46Z,use_quota=True,user_id='522558ad2af04beaa7c8805ed9ea5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Creating volume 350f59e6-cb4a-4034-ad7f-669776dc14b0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:46 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:46:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:46 devstack sudo[92115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0 1073741824
Nov 05 03:46:46 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:47 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0 1073741824" returned: 0 in 0.833s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:47 devstack sudo[92141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0
Nov 05 03:46:47 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:47 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa45304-e33e-4128-af5d-1c83b86d04ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350f59e6-cb4a-4034-ad7f-669776dc14b0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18767e0-f921-4b3a-a4f4-77979d3c0b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Volume volume-350f59e6-cb4a-4034-ad7f-669776dc14b0 (350f59e6-cb4a-4034-ad7f-669776dc14b0): created successfully
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18767e0-f921-4b3a-a4f4-77979d3c0b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Flow 'volume_create_manager' (1d59ebdf-e668-4d05-9487-686aa9dd5935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9354648c-0f41-4fd9-8dd5-c0b3027b0ea5 tempest-VolumesTransfersTest-2140712187 None] Created volume successfully.
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Acquiring lock "cinder-350f59e6-cb4a-4034-ad7f-669776dc14b0-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-350f59e6-cb4a-4034-ad7f-669776dc14b0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Acquiring lock "cinder-quobyte-350f59e6-cb4a-4034-ad7f-669776dc14b0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-quobyte-350f59e6-cb4a-4034-ad7f-669776dc14b0" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed17460-b9c3-4f3f-9dc1-f32839e2f957]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:49 devstack sudo[92145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0
Nov 05 03:46:49 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:49 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0" returned: 0 in 0.566s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:49 devstack sudo[92151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0
Nov 05 03:46:49 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:50 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-350f59e6-cb4a-4034-ad7f-669776dc14b0" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-quobyte-350f59e6-cb4a-4034-ad7f-669776dc14b0" released by "delete_volume" :: held 0.957s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=75,cinder:INSERT=13,cinder:DELETE=8,cinder:SELECT=68 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Created reservations ['2910ccf5-6047-4370-bc26-684d1cee5b67', '91cec170-d0a5-4bc5-ae0e-0ff9071f0e01', '1a157e6a-efb1-41e2-8a84-8513b03e0f15', 'fede724a-5e9a-4026-9846-20bf31907019'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:50 devstack sudo[92154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:46:50 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:50 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.310s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Deleted volume successfully.
Nov 05 03:46:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-336334fa-47b7-49c2-946e-0456799861ed tempest-VolumesTransfersTest-1198032870 None] Lock "cinder-350f59e6-cb4a-4034-ad7f-669776dc14b0-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Flow 'volume_create_manager' (935839bc-ec99-478c-91f8-04d497a5d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9babfdc8-2e8d-44ca-b468-700e31ffeb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9babfdc8-2e8d-44ca-b468-700e31ffeb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-39216231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55935055c44d4f51b4629a75be4d3b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:51Z,use_quota=True,user_id='26b3d33dd924447cbc02febb80f7b448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c4e626-d0bb-4059-8339-b2877aa5bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c4e626-d0bb-4059-8339-b2877aa5bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126467fb-7978-4bfd-9a2a-081809ba9a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126467fb-7978-4bfd-9a2a-081809ba9a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d', 'volume_name': 'volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab5a89970>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a86bda2-f5a9-4c80-8674-22214c728dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a86bda2-f5a9-4c80-8674-22214c728dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fcc1f3-d946-4bac-923d-c8813a884d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Volume ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab5a89970>}
Nov 05 03:46:52 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Trying to clone ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d from image be17f312-5d93-463e-be81-a5040fe456d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:46:52 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:46:52 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:46:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1ea079-557a-4115-9ad7-51822e4d89cd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:52 devstack sudo[92182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD
Nov 05 03:46:52 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:53 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:53 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 is fetched for user 26b3d33dd924447cbc02febb80f7b448. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:46:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c0e89-b23b-44e2-a5f2-51c7584085f3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:54 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD
Nov 05 03:46:54 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:54 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-39216231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55935055c44d4f51b4629a75be4d3b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:51Z,use_quota=True,user_id='26b3d33dd924447cbc02febb80f7b448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Creating volume ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:54 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:46:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:54 devstack sudo[92216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d 1073741824
Nov 05 03:46:54 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:55 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d 1073741824" returned: 0 in 0.949s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:55 devstack sudo[92226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d
Nov 05 03:46:55 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:55 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:55 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Attempting download of be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:46:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[347d2597-bc6a-44b1-b66d-ddb42eeafab1]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_6kuf44gm {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:56 devstack sudo[92230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_6kuf44gm
Nov 05 03:46:56 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:56 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_6kuf44gm" returned: 0 in 0.396s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_6kuf44gm {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:56 devstack sudo[92234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_6kuf44gm
Nov 05 03:46:56 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:56 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_6kuf44gm" returned: 1 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_6kuf44gm' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:46:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc18145b-c9dd-4a4b-9fac-41995beaa36c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:56 devstack sudo[92238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD
Nov 05 03:46:56 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:57 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:57 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] be17f312-5d93-463e-be81-a5040fe456d8 was qcow2, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:46:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:57 devstack sudo[92243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d
Nov 05 03:46:57 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-e218d27f-bd7c-4ced-9c1d-036fcc17547f req-0d973430-e95c-4d27-9a81-aeff091d17c6 tempest-AttachVolumeNegativeTest-256552439 None] Terminate volume connection completed successfully.
Nov 05 03:46:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-e218d27f-bd7c-4ced-9c1d-036fcc17547f req-0d973430-e95c-4d27-9a81-aeff091d17c6 tempest-AttachVolumeNegativeTest-256552439 None] Deleting attachment 1c5f891e-6297-4ec4-b0c0-461741424704. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:46:59 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d" returned: 0 in 2.486s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:59 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8__lyhh8codevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:46:59 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Converted 112.00 MB image at 45.04 MB/s
Nov 05 03:46:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:59 devstack sudo[92257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d 1G
Nov 05 03:46:59 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:00 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d 1G" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Downloaded image be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 for user 26b3d33dd924447cbc02febb80f7b448 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Marking volume ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Copying metadata from image be17f312-5d93-463e-be81-a5040fe456d8 to ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Creating volume glance metadata for volume ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d backed by image be17f312-5d93-463e-be81-a5040fe456d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fcc1f3-d946-4bac-923d-c8813a884d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab5a89970>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475d4213-0adb-4338-9cf8-6deb2adf4e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=82,cinder:UPDATE=65,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:47:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Volume volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d (ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d): created successfully
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475d4213-0adb-4338-9cf8-6deb2adf4e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Flow 'volume_create_manager' (935839bc-ec99-478c-91f8-04d497a5d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cfe291dd-77fd-41f7-a019-4156b662441a tempest-ServerActionsTestOtherA-1465707758 None] Created volume successfully.
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (dee61645-a7a1-477d-bfea-cae2a03c56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c564e12-a23d-4b08-a0d8-a6db4850b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c564e12-a23d-4b08-a0d8-a6db4850b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1727570379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5522d28f-0a78-401e-9824-cfbc640575bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:01Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46ba3c6-4dca-431d-aa39-9c2332403dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46ba3c6-4dca-431d-aa39-9c2332403dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e44786-1ef0-41d9-a465-e3e4b5bdea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e44786-1ef0-41d9-a465-e3e4b5bdea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5522d28f-0a78-401e-9824-cfbc640575bb', 'volume_name': 'volume-5522d28f-0a78-401e-9824-cfbc640575bb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8739b5f-6e5c-4fec-ab8d-03f60b21fec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8739b5f-6e5c-4fec-ab8d-03f60b21fec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21b0b01-a880-4389-9223-2f18fbd43209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Volume 5522d28f-0a78-401e-9824-cfbc640575bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5522d28f-0a78-401e-9824-cfbc640575bb', 'volume_size': 1}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1727570379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5522d28f-0a78-401e-9824-cfbc640575bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:01Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Creating volume 5522d28f-0a78-401e-9824-cfbc640575bb {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:47:01 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:01 devstack sudo[92263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb 1073741824
Nov 05 03:47:01 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:01 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb 1073741824" returned: 0 in 0.655s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:01 devstack sudo[92289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb
Nov 05 03:47:01 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:02 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb" returned: 0 in 0.482s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:47:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21b0b01-a880-4389-9223-2f18fbd43209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5522d28f-0a78-401e-9824-cfbc640575bb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601498e7-2d8e-4748-8e24-519e0bb4ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Volume volume-5522d28f-0a78-401e-9824-cfbc640575bb (5522d28f-0a78-401e-9824-cfbc640575bb): created successfully
Nov 05 03:47:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601498e7-2d8e-4748-8e24-519e0bb4ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (dee61645-a7a1-477d-bfea-cae2a03c56f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-385217d9-83c7-4a4f-a61a-ce326cf79e77 tempest-VolumesGetTest-2014049113 None] Created volume successfully.
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (8a988285-6c42-4e64-936b-f873e4d2a1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65ca8a0-cbf4-4a51-9c2c-6aadf74d71f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65ca8a0-cbf4-4a51-9c2c-6aadf74d71f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1067775469',display_name='tempest-VolumesGetTest-Volume-385810091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268ee143-5aa0-4bf8-a131-aa7297944980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:04Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd61824-c4bb-4fc6-8d70-44f36d0d762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd61824-c4bb-4fc6-8d70-44f36d0d762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8929384d-5539-4b79-9359-b11f03cc3b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8929384d-5539-4b79-9359-b11f03cc3b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268ee143-5aa0-4bf8-a131-aa7297944980', 'volume_name': 'volume-268ee143-5aa0-4bf8-a131-aa7297944980', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2570d-fa5e-4cbd-9516-93a913b69683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2570d-fa5e-4cbd-9516-93a913b69683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf18880-2590-4c42-b9c1-88b1abae0323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Volume 268ee143-5aa0-4bf8-a131-aa7297944980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268ee143-5aa0-4bf8-a131-aa7297944980', 'volume_size': 1}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1067775469',display_name='tempest-VolumesGetTest-Volume-385810091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268ee143-5aa0-4bf8-a131-aa7297944980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:04Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Creating volume 268ee143-5aa0-4bf8-a131-aa7297944980 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:47:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:47:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:04 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980 1073741824
Nov 05 03:47:04 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:05 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980 1073741824" returned: 0 in 0.689s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:05 devstack sudo[92316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980
Nov 05 03:47:05 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:05 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-b6c8e01c-262a-4ad0-8384-c1fb8d01f82f req-939cf6bc-35ff-4154-9af6-921e51736fe7 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-b6c8e01c-262a-4ad0-8384-c1fb8d01f82f req-939cf6bc-35ff-4154-9af6-921e51736fe7 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-b6c8e01c-262a-4ad0-8384-c1fb8d01f82f req-939cf6bc-35ff-4154-9af6-921e51736fe7 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf18880-2590-4c42-b9c1-88b1abae0323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268ee143-5aa0-4bf8-a131-aa7297944980', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1810d449-b29a-4bc0-a081-58705e6dc662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Volume volume-268ee143-5aa0-4bf8-a131-aa7297944980 (268ee143-5aa0-4bf8-a131-aa7297944980): created successfully
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1810d449-b29a-4bc0-a081-58705e6dc662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (8a988285-6c42-4e64-936b-f873e4d2a1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-b6c8e01c-262a-4ad0-8384-c1fb8d01f82f req-939cf6bc-35ff-4154-9af6-921e51736fe7 tempest-ServerActionsTestOtherA-1465707758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f168b18b-43b9-4565-8fcc-fae97d7b96f3', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:47:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-93d9819a-ec31-4b02-9225-6733f91b2b2e tempest-VolumesGetTest-2014049113 None] Created volume successfully.
Nov 05 03:47:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-b6c8e01c-262a-4ad0-8384-c1fb8d01f82f req-939cf6bc-35ff-4154-9af6-921e51736fe7 tempest-ServerActionsTestOtherA-1465707758 None] attachment_update completed successfully.
Nov 05 03:47:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-268ee143-5aa0-4bf8-a131-aa7297944980-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Lock "cinder-268ee143-5aa0-4bf8-a131-aa7297944980-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-268ee143-5aa0-4bf8-a131-aa7297944980" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-268ee143-5aa0-4bf8-a131-aa7297944980" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9613fb2e-632b-4877-804c-9a5a12b25450]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:07 devstack sudo[92342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980
Nov 05 03:47:07 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:07 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980" returned: 0 in 0.507s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:07 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980
Nov 05 03:47:07 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:07 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-268ee143-5aa0-4bf8-a131-aa7297944980" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-268ee143-5aa0-4bf8-a131-aa7297944980" released by "delete_volume" :: held 0.897s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Created reservations ['4ed08180-6fd2-42a6-ad24-81ee50b07f1d', '0805ae4b-23cb-40dd-a68b-b47d71147486', '89c05825-d0ca-416c-8366-5f0cb2f97c39', 'f7775510-425b-45b6-9536-6f204a973c27'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:08 devstack sudo[92352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:47:08 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:08 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Deleted volume successfully.
Nov 05 03:47:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9b4a9ab-cc92-4088-be5d-c58b836a4bd2 tempest-VolumesGetTest-2014049113 None] Lock "cinder-268ee143-5aa0-4bf8-a131-aa7297944980-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-5522d28f-0a78-401e-9824-cfbc640575bb-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Lock "cinder-5522d28f-0a78-401e-9824-cfbc640575bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-5522d28f-0a78-401e-9824-cfbc640575bb" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-5522d28f-0a78-401e-9824-cfbc640575bb" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b349be0b-759d-4ebc-87f1-8a605bfdf98b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:09 devstack sudo[92357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb
Nov 05 03:47:09 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:09 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb" returned: 0 in 0.433s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:09 devstack sudo[92363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb
Nov 05 03:47:09 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:10 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5522d28f-0a78-401e-9824-cfbc640575bb" returned: 0 in 0.310s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-5522d28f-0a78-401e-9824-cfbc640575bb" released by "delete_volume" :: held 0.800s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Created reservations ['526d0015-d2e8-4207-8712-633d05fae229', 'f57b99cd-3f33-469c-b574-e354f9a133c1', 'd0c6f84d-452d-4c2f-9576-ac5dea328d95', '5755aea6-be5e-4585-8132-0e803f3494a5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:10 devstack sudo[92366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:47:10 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Acquiring lock "cinder-adcd60c7-ed17-419e-81f8-a84f7ead620a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "cinder-adcd60c7-ed17-419e-81f8-a84f7ead620a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Acquiring lock "cinder-quobyte-adcd60c7-ed17-419e-81f8-a84f7ead620a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "cinder-quobyte-adcd60c7-ed17-419e-81f8-a84f7ead620a" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ad187-117f-4472-9b27-fc978ea94d08]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:10 devstack sudo[92369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:47:10 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:10 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Deleted volume successfully.
Nov 05 03:47:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6959175a-35bb-4fbc-b364-93568b2cce94 tempest-VolumesGetTest-2014049113 None] Lock "cinder-5522d28f-0a78-401e-9824-cfbc640575bb-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:10 devstack sudo[92371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a
Nov 05 03:47:10 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:11 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.618s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (339ad769-5e4b-406c-8954-b28df3b3ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf1163c-b599-4c0b-b096-946d8ebb04f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:11 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a" returned: 0 in 0.668s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf1163c-b599-4c0b-b096-946d8ebb04f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1028460762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d9afcb-eef7-459a-a703-bb34cb05774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:11Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:11 devstack sudo[92474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a
Nov 05 03:47:11 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9224b09-e488-493c-98d8-6a0914eccade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9224b09-e488-493c-98d8-6a0914eccade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c4746b-a28e-4e62-b663-ce623d907533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c4746b-a28e-4e62-b663-ce623d907533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d9afcb-eef7-459a-a703-bb34cb05774a', 'volume_name': 'volume-05d9afcb-eef7-459a-a703-bb34cb05774a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012887ad-a0d0-4677-a0c3-a0e7d2175fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012887ad-a0d0-4677-a0c3-a0e7d2175fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00f5f91-f450-4804-a6f1-d94b7f300876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:11 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Volume 05d9afcb-eef7-459a-a703-bb34cb05774a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d9afcb-eef7-459a-a703-bb34cb05774a', 'volume_size': 1}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1028460762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d9afcb-eef7-459a-a703-bb34cb05774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:11Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Creating volume 05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:47:11 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:11 devstack sudo[92480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a 1073741824
Nov 05 03:47:11 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:11 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-adcd60c7-ed17-419e-81f8-a84f7ead620a" returned: 0 in 0.529s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "cinder-quobyte-adcd60c7-ed17-419e-81f8-a84f7ead620a" released by "delete_volume" :: held 1.307s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Created reservations ['99e25c37-529e-4609-9685-706022b5a437', 'ec364614-4a1c-4fb0-8dbc-05a55feda36e', 'f641cee1-5f66-49fa-94ca-002ef77b5744', '1e1aee4e-ac02-453b-b135-446e6296aa23'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:12 devstack sudo[92826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:47:12 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:12 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a 1073741824" returned: 0 in 0.958s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:12 devstack sudo[92840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a
Nov 05 03:47:12 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:12 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Deleted volume successfully.
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ded57c10-d7cc-4c31-a710-b4bd3435361d tempest-AttachVolumeShelveTestJSON-2128549207 None] Lock "cinder-adcd60c7-ed17-419e-81f8-a84f7ead620a-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:12 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a" returned: 0 in 0.369s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00f5f91-f450-4804-a6f1-d94b7f300876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d9afcb-eef7-459a-a703-bb34cb05774a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0347ba29-c873-4f9d-baea-d92bbc97f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Volume volume-05d9afcb-eef7-459a-a703-bb34cb05774a (05d9afcb-eef7-459a-a703-bb34cb05774a): created successfully
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0347ba29-c873-4f9d-baea-d92bbc97f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (339ad769-5e4b-406c-8954-b28df3b3ac22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a4c95ff8-ea4e-4d6b-93f7-39d6f66ea3a0 tempest-VolumesGetTest-2014049113 None] Created volume successfully.
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (d6114449-7450-4ff8-95dd-4f54aedf2f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e475490d-3d77-47ff-9544-0c9f4c913cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e475490d-3d77-47ff-9544-0c9f4c913cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2094842585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0002d31-c96e-4043-a76a-734ac92024f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=05d9afcb-eef7-459a-a703-bb34cb05774a,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:14Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d25134-89de-4bc2-98aa-8fcebe3c3adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d25134-89de-4bc2-98aa-8fcebe3c3adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f89807-1819-4367-b108-973cd7549104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f89807-1819-4367-b108-973cd7549104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e0002d31-c96e-4043-a76a-734ac92024f7', 'volume_name': 'volume-e0002d31-c96e-4043-a76a-734ac92024f7', 'volume_size': 1, 'source_volid': '05d9afcb-eef7-459a-a703-bb34cb05774a', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6285ce-af6f-4121-8ae9-4b60e75bd508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6285ce-af6f-4121-8ae9-4b60e75bd508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30128576-615b-4203-a079-b9fd8ed35a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Volume e0002d31-c96e-4043-a76a-734ac92024f7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e0002d31-c96e-4043-a76a-734ac92024f7', 'volume_size': 1, 'source_volid': '05d9afcb-eef7-459a-a703-bb34cb05774a', 'source_volstatus': 'available'}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:14 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Cloning volume 05d9afcb-eef7-459a-a703-bb34cb05774a to volume e0002d31-c96e-4043-a76a-734ac92024f7
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Creating offline snapshot 945239a9-3ff7-4745-87e6-86e431bc360a of volume 05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd2c74c-a0de-4805-ae90-9b099df797c0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:14 devstack sudo[92852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a
Nov 05 03:47:14 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:15 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a" returned: 0 in 0.636s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:15 devstack sudo[92857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a 1G
Nov 05 03:47:15 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:16 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a 1G" returned: 0 in 0.915s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d9afcb-eef7-459a-a703-bb34cb05774a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:16 devstack sudo[92868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d9afcb-eef7-459a-a703-bb34cb05774a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a
Nov 05 03:47:16 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:16 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d9afcb-eef7-459a-a703-bb34cb05774a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a" returned: 0 in 0.520s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:16 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a is being set with open permissions: ugo+rw
Nov 05 03:47:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:16 devstack sudo[92884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a
Nov 05 03:47:16 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:17 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a" returned: 0 in 0.553s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:17 devstack sudo[92889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.info
Nov 05 03:47:17 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:17 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.info" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:17 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.info is being set with open permissions: ugo+rw
Nov 05 03:47:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:17 devstack sudo[92892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.info
Nov 05 03:47:17 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:18 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.info" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-e0002d31-c96e-4043-a76a-734ac92024f7" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-e0002d31-c96e-4043-a76a-734ac92024f7" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] snapshot: 945239a9-3ff7-4745-87e6-86e431bc360a, volume: e0002d31-c96e-4043-a76a-734ac92024f7,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c3035-3feb-4781-a4ae-95e0acd7d250]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:18 devstack sudo[92895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a
Nov 05 03:47:18 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:18 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a" returned: 0 in 0.679s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d9afcb-eef7-459a-a703-bb34cb05774a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7710c500-1c59-4a4f-ba85-f219d2009247]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:19 devstack sudo[92904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a
Nov 05 03:47:19 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:19 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a" returned: 0 in 0.511s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:47:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:47:19 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:47:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:19 devstack sudo[92909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7
Nov 05 03:47:19 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:27 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=35,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:47:27 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=42,cinder:INSERT=22,cinder:UPDATE=49,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:47:33 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7" returned: 0 in 14.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:33 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a, size 1024.00 MB, duration 14.30 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:47:33 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Converted 1024.00 MB image at 71.62 MB/s
Nov 05 03:47:33 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7 is being set with open permissions: ugo+rw
Nov 05 03:47:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:33 devstack sudo[93038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7
Nov 05 03:47:33 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:34 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7" returned: 0 in 0.461s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-e0002d31-c96e-4043-a76a-734ac92024f7" released by "_copy_volume_from_snapshot" :: held 16.067s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-945239a9-3ff7-4745-87e6-86e431bc360a" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-945239a9-3ff7-4745-87e6-86e431bc360a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Deleting offline snapshot 945239a9-3ff7-4745-87e6-86e431bc360a of volume 05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] snapshot_file for this snap is: volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a107e33d-26bf-4183-a335-fdacd5d889dd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:34 devstack sudo[93053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a
Nov 05 03:47:34 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:35 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a" returned: 0 in 0.820s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d9afcb-eef7-459a-a703-bb34cb05774a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:47:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9b897-23d9-4f1b-a222-6d180ab6978f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:35 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a
Nov 05 03:47:35 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:36 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a" returned: 0 in 1.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:36 devstack sudo[93102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a
Nov 05 03:47:36 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:37 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a" returned: 0 in 0.794s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:37 devstack sudo[93108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a
Nov 05 03:47:37 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:37 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a.945239a9-3ff7-4745-87e6-86e431bc360a" returned: 0 in 0.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-945239a9-3ff7-4745-87e6-86e431bc360a" released by "_delete_snapshot" :: held 3.480s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.209s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30128576-615b-4203-a079-b9fd8ed35a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0002d31-c96e-4043-a76a-734ac92024f7', 'volume_size': 1, 'source_volid': '05d9afcb-eef7-459a-a703-bb34cb05774a', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18aeb569-9579-4cdb-8a3c-55887d882ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Volume volume-e0002d31-c96e-4043-a76a-734ac92024f7 (e0002d31-c96e-4043-a76a-734ac92024f7): created successfully
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18aeb569-9579-4cdb-8a3c-55887d882ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (d6114449-7450-4ff8-95dd-4f54aedf2f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-64117129-cf8e-48a2-8e88-d1bbca8f89a0 tempest-VolumesGetTest-2014049113 None] Created volume successfully.
Nov 05 03:47:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ea219784-7072-4efa-9a1c-96e01186877d req-196d7715-d3d9-413c-87bd-a3e97a9800b3 tempest-ServerActionsTestOtherA-1465707758 None] Terminate volume connection completed successfully.
Nov 05 03:47:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ea219784-7072-4efa-9a1c-96e01186877d req-196d7715-d3d9-413c-87bd-a3e97a9800b3 tempest-ServerActionsTestOtherA-1465707758 None] Deleting attachment f168b18b-43b9-4565-8fcc-fae97d7b96f3. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (3dbc7f50-ae12-4854-ab04-5949a5635f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29bc0b2-6a14-4a13-84ce-70c17160f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29bc0b2-6a14-4a13-84ce-70c17160f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-723415863',display_name='tempest-VolumesGetTest-Volume-1278405375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74c883c-79aa-4f46-994b-df06a8dab475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:40Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235b40b7-ec3d-4e65-9696-36c3096e4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235b40b7-ec3d-4e65-9696-36c3096e4f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa748414-21dd-4a25-bf63-64124e412947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa748414-21dd-4a25-bf63-64124e412947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74c883c-79aa-4f46-994b-df06a8dab475', 'volume_name': 'volume-c74c883c-79aa-4f46-994b-df06a8dab475', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7506885c-c63f-4b45-aa4b-edff2cf2ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7506885c-c63f-4b45-aa4b-edff2cf2ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f4fba1-ead9-4f70-bea5-cf094ed811aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Volume c74c883c-79aa-4f46-994b-df06a8dab475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74c883c-79aa-4f46-994b-df06a8dab475', 'volume_size': 1}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-723415863',display_name='tempest-VolumesGetTest-Volume-1278405375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74c883c-79aa-4f46-994b-df06a8dab475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:40Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Creating volume c74c883c-79aa-4f46-994b-df06a8dab475 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:47:40 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:47:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:40 devstack sudo[93135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475 1073741824
Nov 05 03:47:40 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:41 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475 1073741824" returned: 0 in 0.596s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:41 devstack sudo[93142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475
Nov 05 03:47:41 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:41 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475" returned: 0 in 0.448s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f4fba1-ead9-4f70-bea5-cf094ed811aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74c883c-79aa-4f46-994b-df06a8dab475', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdc4b71-6692-4ab2-a240-0b9a12360664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Volume volume-c74c883c-79aa-4f46-994b-df06a8dab475 (c74c883c-79aa-4f46-994b-df06a8dab475): created successfully
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdc4b71-6692-4ab2-a240-0b9a12360664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (3dbc7f50-ae12-4854-ab04-5949a5635f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-50d01162-7fcd-46a6-b180-b5bc3fe01903 tempest-VolumesGetTest-2014049113 None] Created volume successfully.
Nov 05 03:47:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-c74c883c-79aa-4f46-994b-df06a8dab475-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Lock "cinder-c74c883c-79aa-4f46-994b-df06a8dab475-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-c74c883c-79aa-4f46-994b-df06a8dab475" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-c74c883c-79aa-4f46-994b-df06a8dab475" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b750270-854c-444b-8e03-e062a2b1e125]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ea219784-7072-4efa-9a1c-96e01186877d req-a18d6318-b605-401c-9757-eaedea71e601 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ea219784-7072-4efa-9a1c-96e01186877d req-a18d6318-b605-401c-9757-eaedea71e601 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ea219784-7072-4efa-9a1c-96e01186877d req-a18d6318-b605-401c-9757-eaedea71e601 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ea219784-7072-4efa-9a1c-96e01186877d req-a18d6318-b605-401c-9757-eaedea71e601 tempest-ServerActionsTestOtherA-1465707758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af0e987f-21db-4eb8-b057-ccb7140aa728', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:47:43 devstack sudo[93153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475
Nov 05 03:47:43 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ea219784-7072-4efa-9a1c-96e01186877d req-a18d6318-b605-401c-9757-eaedea71e601 tempest-ServerActionsTestOtherA-1465707758 None] attachment_update completed successfully.
Nov 05 03:47:43 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475" returned: 0 in 0.787s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:43 devstack sudo[93173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475
Nov 05 03:47:43 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:44 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c74c883c-79aa-4f46-994b-df06a8dab475" returned: 0 in 0.446s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-c74c883c-79aa-4f46-994b-df06a8dab475" released by "delete_volume" :: held 1.381s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Created reservations ['a725edef-95a5-41d2-8872-00cf4aaf954e', '8a5cfea3-31a4-4b8b-9245-ca14a3c90e71', 'd181c06f-54ca-4acb-b965-74be97642ee6', '24fbea78-28fd-4373-aaf2-cc70bc9922dc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:44 devstack sudo[93615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:47:44 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:45 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.440s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Deleted volume successfully.
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90d11cf2-2222-46dd-91af-c54be233f400 tempest-VolumesGetTest-2014049113 None] Lock "cinder-c74c883c-79aa-4f46-994b-df06a8dab475-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-e0002d31-c96e-4043-a76a-734ac92024f7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Lock "cinder-e0002d31-c96e-4043-a76a-734ac92024f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-e0002d31-c96e-4043-a76a-734ac92024f7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-e0002d31-c96e-4043-a76a-734ac92024f7" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9202207-aad6-48ae-889b-9966fe8f296b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:45 devstack sudo[93632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7
Nov 05 03:47:45 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:46 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7" returned: 0 in 0.573s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:46 devstack sudo[93638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7
Nov 05 03:47:46 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:46 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e0002d31-c96e-4043-a76a-734ac92024f7" returned: 0 in 0.507s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-e0002d31-c96e-4043-a76a-734ac92024f7" released by "delete_volume" :: held 1.171s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Created reservations ['f936d6ef-b675-429f-a767-c871e0ecf5fb', '8190fc98-e316-4239-a856-0f5179c6c8d6', '7ac18a31-e8c8-447f-97a4-deb4ccabb5a8', '8f2637b0-b106-42cd-b686-aa0eecfd7d82'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:46 devstack sudo[93643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:47:46 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:47 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:47 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Deleted volume successfully.
Nov 05 03:47:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0e675872-c759-4a0d-ab5a-02c5b58e67e5 tempest-VolumesGetTest-2014049113 None] Lock "cinder-e0002d31-c96e-4043-a76a-734ac92024f7-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-05d9afcb-eef7-459a-a703-bb34cb05774a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Lock "cinder-05d9afcb-eef7-459a-a703-bb34cb05774a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-05d9afcb-eef7-459a-a703-bb34cb05774a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-05d9afcb-eef7-459a-a703-bb34cb05774a" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f6c961-a1f1-4beb-aa30-1c0e25ac0304]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:48 devstack sudo[93646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a
Nov 05 03:47:48 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:49 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a" returned: 0 in 0.940s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:49 devstack sudo[93659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a
Nov 05 03:47:49 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:49 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-05d9afcb-eef7-459a-a703-bb34cb05774a" returned: 0 in 0.802s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-05d9afcb-eef7-459a-a703-bb34cb05774a" released by "delete_volume" :: held 1.855s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:49 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Created reservations ['760340ec-403a-4cc7-8219-0c0180ef9e23', '8e678f82-5f90-403f-924c-e7edee73f11e', '7266b3b3-7d20-4ab3-820e-8b1ac91e69d0', 'fbfed856-7f14-4dea-ab71-59be58fd2038'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:50 devstack sudo[93671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:47:50 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:50 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.557s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Deleted volume successfully.
Nov 05 03:47:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7ee926d-545c-4d74-8f33-18f0b8a1a13f tempest-VolumesGetTest-2014049113 None] Lock "cinder-05d9afcb-eef7-459a-a703-bb34cb05774a-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:52 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:47:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (94234017-79f4-42cd-a1f0-8619e71baa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0b3f0d-5867-45fd-8198-d0db2acbe162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0b3f0d-5867-45fd-8198-d0db2acbe162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1649744559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a231ef28-9ae4-4a8a-b289-2563a4d768f3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:53Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68834328-153b-452d-a435-c567369181d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68834328-153b-452d-a435-c567369181d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b53dc7-e532-4769-8761-3536ff29fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b53dc7-e532-4769-8761-3536ff29fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a231ef28-9ae4-4a8a-b289-2563a4d768f3', 'volume_name': 'volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab536eed0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcae294-ff81-4f95-b58d-d1eddf8f439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcae294-ff81-4f95-b58d-d1eddf8f439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac7b8a7-94bc-4a06-9b5b-ac919b2912aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Volume a231ef28-9ae4-4a8a-b289-2563a4d768f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab536eed0>}
Nov 05 03:47:53 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Trying to clone a231ef28-9ae4-4a8a-b289-2563a4d768f3 from image be17f312-5d93-463e-be81-a5040fe456d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:47:54 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:47:54 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:47:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[872ee88c-12a9-4744-b70e-c4d04bacc749]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:54 devstack sudo[93677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD
Nov 05 03:47:54 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:54 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:54 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 is fetched for user 01efb5175ffe49789186f0ff0a0fe2eb. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:47:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a0356e-7614-4385-9349-01a98b8e4f40]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:54 devstack sudo[93683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD
Nov 05 03:47:54 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:55 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1649744559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a231ef28-9ae4-4a8a-b289-2563a4d768f3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:53Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Creating volume a231ef28-9ae4-4a8a-b289-2563a4d768f3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:47:55 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:55 devstack sudo[93688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 1073741824
Nov 05 03:47:55 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:55 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 1073741824" returned: 0 in 0.517s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:55 devstack sudo[93694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3
Nov 05 03:47:55 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:56 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Attempting download of be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume a231ef28-9ae4-4a8a-b289-2563a4d768f3. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dde5b1-ccac-4bec-9e53-3ce21764d1d4]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_4xft3y75 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:56 devstack sudo[93700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_4xft3y75
Nov 05 03:47:56 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:56 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_4xft3y75" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_4xft3y75 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:56 devstack sudo[93706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_4xft3y75
Nov 05 03:47:56 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:47:57 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Flow 'volume_create_manager' (f1106a22-4230-4c67-9d2d-52bda20821d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97cda8b-26d0-44e4-881c-cc632528f7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_4xft3y75" returned: 1 in 0.550s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_4xft3y75' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e25245-8c19-4d9f-81bd-90761f521b1d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97cda8b-26d0-44e4-881c-cc632528f7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1314304834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf944060-30b8-4729-8b8a-75c3d0cd8b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ccd832c08344bbb560bec09785e5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:57Z,use_quota=True,user_id='bb42643bf18d4f9981ac0fe9acb3d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f8ae05-b8fa-4f57-af69-38057499bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f8ae05-b8fa-4f57-af69-38057499bc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0964d1fc-804c-4e76-be68-26af00aa94b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0964d1fc-804c-4e76-be68-26af00aa94b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf944060-30b8-4729-8b8a-75c3d0cd8b5b', 'volume_name': 'volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfd6ad2-e3fb-4aad-b679-291a011cbbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfd6ad2-e3fb-4aad-b679-291a011cbbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eded89-6f97-4cdf-9418-2c023900a3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Volume cf944060-30b8-4729-8b8a-75c3d0cd8b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b', 'volume_size': 1}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1314304834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf944060-30b8-4729-8b8a-75c3d0cd8b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ccd832c08344bbb560bec09785e5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:57Z,use_quota=True,user_id='bb42643bf18d4f9981ac0fe9acb3d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Creating volume cf944060-30b8-4729-8b8a-75c3d0cd8b5b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:47:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:57 devstack sudo[93712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b 1073741824
Nov 05 03:47:57 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:57 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD
Nov 05 03:47:57 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:57 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD" returned: 0 in 0.509s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] be17f312-5d93-463e-be81-a5040fe456d8 was qcow2, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:57 devstack sudo[93722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3
Nov 05 03:47:57 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:57 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b 1073741824" returned: 0 in 0.678s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:58 devstack sudo[93728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b
Nov 05 03:47:58 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:58 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b" returned: 0 in 0.525s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eded89-6f97-4cdf-9418-2c023900a3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8235c91-58a3-45ce-a320-ccf7750294b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:47:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Volume volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b (cf944060-30b8-4729-8b8a-75c3d0cd8b5b): created successfully
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8235c91-58a3-45ce-a320-ccf7750294b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:47:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Flow 'volume_create_manager' (f1106a22-4230-4c67-9d2d-52bda20821d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:47:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-40a982b6-4cec-4462-b061-197249bca8fd tempest-AttachVolumeNegativeTest-256552439 None] Created volume successfully.
Nov 05 03:48:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-204d03f0-cbf6-46a4-85ec-b7f1908f7193 req-e78c1634-438c-410a-92c7-11a28689ed65 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-204d03f0-cbf6-46a4-85ec-b7f1908f7193 req-e78c1634-438c-410a-92c7-11a28689ed65 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-204d03f0-cbf6-46a4-85ec-b7f1908f7193 req-e78c1634-438c-410a-92c7-11a28689ed65 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-204d03f0-cbf6-46a4-85ec-b7f1908f7193 req-e78c1634-438c-410a-92c7-11a28689ed65 tempest-AttachVolumeNegativeTest-256552439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '811bb0e6-cb5f-4926-8094-fc2909847b62', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:48:00 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3" returned: 0 in 3.001s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:00 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_z1w774e1devstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:48:00 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Converted 112.00 MB image at 37.31 MB/s
Nov 05 03:48:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:00 devstack sudo[93765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 1G
Nov 05 03:48:00 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-204d03f0-cbf6-46a4-85ec-b7f1908f7193 req-e78c1634-438c-410a-92c7-11a28689ed65 tempest-AttachVolumeNegativeTest-256552439 None] attachment_update completed successfully.
Nov 05 03:48:01 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 1G" returned: 0 in 0.562s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Downloaded image be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume a231ef28-9ae4-4a8a-b289-2563a4d768f3 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 for user 01efb5175ffe49789186f0ff0a0fe2eb is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Marking volume a231ef28-9ae4-4a8a-b289-2563a4d768f3 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Copying metadata from image be17f312-5d93-463e-be81-a5040fe456d8 to a231ef28-9ae4-4a8a-b289-2563a4d768f3. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Creating volume glance metadata for volume a231ef28-9ae4-4a8a-b289-2563a4d768f3 backed by image be17f312-5d93-463e-be81-a5040fe456d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac7b8a7-94bc-4a06-9b5b-ac919b2912aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab536eed0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c362e7-2360-4ae6-9448-b9c922cd8d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Volume volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 (a231ef28-9ae4-4a8a-b289-2563a4d768f3): created successfully
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c362e7-2360-4ae6-9448-b9c922cd8d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (94234017-79f4-42cd-a1f0-8619e71baa52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e162957b-5e43-4872-9c40-d5063238dab1 tempest-VolumesGetTest-2014049113 None] Created volume successfully.
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (b7e62c54-4536-4946-8854-94bda6e88990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09b876f-c0c7-4ee5-87a4-02abab1ffd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09b876f-c0c7-4ee5-87a4-02abab1ffd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-742141391',display_name='tempest-VolumesGetTest-Volume-1508701344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8fb7c6-e848-4757-a60a-86c795c77e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:03Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52dbf74-99a0-4d62-8bc4-219c9a2f190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52dbf74-99a0-4d62-8bc4-219c9a2f190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e64e0d0-6201-4bbe-a07b-7611e56a0743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e64e0d0-6201-4bbe-a07b-7611e56a0743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8fb7c6-e848-4757-a60a-86c795c77e78', 'volume_name': 'volume-ee8fb7c6-e848-4757-a60a-86c795c77e78', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab28fa6d-c963-4728-afe9-f61420326aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab28fa6d-c963-4728-afe9-f61420326aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c73758-fdcb-4d63-82af-df00a1879d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Volume ee8fb7c6-e848-4757-a60a-86c795c77e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8fb7c6-e848-4757-a60a-86c795c77e78', 'volume_size': 1}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-742141391',display_name='tempest-VolumesGetTest-Volume-1508701344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8fb7c6-e848-4757-a60a-86c795c77e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096777feddf42a0b6b0e08c2efec668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:03Z,use_quota=True,user_id='01efb5175ffe49789186f0ff0a0fe2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Creating volume ee8fb7c6-e848-4757-a60a-86c795c77e78 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:03 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:48:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:03 devstack sudo[93835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78 1073741824
Nov 05 03:48:03 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:04 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78 1073741824" returned: 0 in 1.121s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:04 devstack sudo[93878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78
Nov 05 03:48:04 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-b9bbf661-6b10-47be-afc7-3aac215aa422 req-0b48d889-9ece-43d3-9b8e-d73ae5abd541 tempest-AttachVolumeNegativeTest-256552439 None] Terminate volume connection completed successfully.
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-b9bbf661-6b10-47be-afc7-3aac215aa422 req-0b48d889-9ece-43d3-9b8e-d73ae5abd541 tempest-AttachVolumeNegativeTest-256552439 None] Deleting attachment 811bb0e6-cb5f-4926-8094-fc2909847b62. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:48:05 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78" returned: 0 in 0.590s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c73758-fdcb-4d63-82af-df00a1879d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8fb7c6-e848-4757-a60a-86c795c77e78', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5c6c60-0b43-4359-bf70-9332cc04cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Volume volume-ee8fb7c6-e848-4757-a60a-86c795c77e78 (ee8fb7c6-e848-4757-a60a-86c795c77e78): created successfully
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5c6c60-0b43-4359-bf70-9332cc04cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Flow 'volume_create_manager' (b7e62c54-4536-4946-8854-94bda6e88990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-95c7c8d5-89af-446e-aa61-7f6cc69e39a5 tempest-VolumesGetTest-2014049113 None] Created volume successfully.
Nov 05 03:48:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-ee8fb7c6-e848-4757-a60a-86c795c77e78-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Lock "cinder-ee8fb7c6-e848-4757-a60a-86c795c77e78-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-ee8fb7c6-e848-4757-a60a-86c795c77e78" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-ee8fb7c6-e848-4757-a60a-86c795c77e78" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fcc09a-b4d3-424f-ad5c-048ff9b433ea]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:07 devstack sudo[93903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78
Nov 05 03:48:07 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:07 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78" returned: 0 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:07 devstack sudo[93910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78
Nov 05 03:48:07 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:07 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee8fb7c6-e848-4757-a60a-86c795c77e78" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-ee8fb7c6-e848-4757-a60a-86c795c77e78" released by "delete_volume" :: held 0.991s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Created reservations ['a0bc12e5-ec7f-46d9-9be3-5f349d2bbdf3', '741d389e-6030-4a68-b166-f53adf29c356', '957bbb1c-5852-4aea-8380-c8684904aaa4', '87642893-574d-4a44-82a3-d779fc44eea7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:08 devstack sudo[93915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:08 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:08 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Deleted volume successfully.
Nov 05 03:48:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2007aa9-ecee-4485-ada8-a109e5708714 tempest-VolumesGetTest-2014049113 None] Lock "cinder-ee8fb7c6-e848-4757-a60a-86c795c77e78-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-a231ef28-9ae4-4a8a-b289-2563a4d768f3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Lock "cinder-a231ef28-9ae4-4a8a-b289-2563a4d768f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Acquiring lock "cinder-quobyte-a231ef28-9ae4-4a8a-b289-2563a4d768f3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-a231ef28-9ae4-4a8a-b289-2563a4d768f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[07884acd-9514-4ebd-9f2a-8a48720076ff]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:09 devstack sudo[93921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3
Nov 05 03:48:09 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:09 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:09 devstack sudo[93926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3
Nov 05 03:48:09 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:10 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a231ef28-9ae4-4a8a-b289-2563a4d768f3" returned: 0 in 0.274s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Lock "cinder-quobyte-a231ef28-9ae4-4a8a-b289-2563a4d768f3" released by "delete_volume" :: held 0.794s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Created reservations ['1257f992-a9bc-40f7-8faf-c362a6a47a93', 'b960bd7a-483e-4cc0-b623-f0a25f9616a6', 'f980deb6-efd9-45e3-813e-d82106311acb', '2b9b70d0-dce5-43a2-bd97-10bd0c33a9c9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:10 devstack sudo[93929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:10 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:10 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Deleted volume successfully.
Nov 05 03:48:10 devstack sudo[93932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:10 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bea5ca6d-4847-4b67-bc1f-063eb78df2e4 tempest-VolumesGetTest-2014049113 None] Lock "cinder-a231ef28-9ae4-4a8a-b289-2563a4d768f3-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:10 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:48:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:48:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Flow 'volume_create_manager' (f67f519c-a59f-41aa-81bd-8b04a7b1adc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ca2f10-3292-49de-88e1-ce50b90b36f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ca2f10-3292-49de-88e1-ce50b90b36f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112736082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0de2efb-cd6f-4c97-8a27-f4121f100439,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b517c223397c4d099902d0cc399e9d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:16Z,use_quota=True,user_id='60f37efee8914513a83e8091f61a4de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068f96dc-4cbd-470d-9def-86a7a68676b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068f96dc-4cbd-470d-9def-86a7a68676b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c943814-1b40-4376-b9ff-bb62f6a3daaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c943814-1b40-4376-b9ff-bb62f6a3daaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0de2efb-cd6f-4c97-8a27-f4121f100439', 'volume_name': 'volume-a0de2efb-cd6f-4c97-8a27-f4121f100439', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f03839-f50d-4009-87f7-01d9016c0eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f03839-f50d-4009-87f7-01d9016c0eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af1c253-cb64-4563-b368-4191b49054cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Volume a0de2efb-cd6f-4c97-8a27-f4121f100439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0de2efb-cd6f-4c97-8a27-f4121f100439', 'volume_size': 1}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112736082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0de2efb-cd6f-4c97-8a27-f4121f100439,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b517c223397c4d099902d0cc399e9d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:16Z,use_quota=True,user_id='60f37efee8914513a83e8091f61a4de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Creating volume a0de2efb-cd6f-4c97-8a27-f4121f100439 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:16 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:48:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:16 devstack sudo[93957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439 1073741824
Nov 05 03:48:16 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:17 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439 1073741824" returned: 0 in 0.761s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:17 devstack sudo[93980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439
Nov 05 03:48:17 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:17 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439" returned: 0 in 0.579s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af1c253-cb64-4563-b368-4191b49054cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0de2efb-cd6f-4c97-8a27-f4121f100439', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2c70fe-4596-48f4-a830-9505d6cc0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Volume volume-a0de2efb-cd6f-4c97-8a27-f4121f100439 (a0de2efb-cd6f-4c97-8a27-f4121f100439): created successfully
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2c70fe-4596-48f4-a830-9505d6cc0294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Flow 'volume_create_manager' (f67f519c-a59f-41aa-81bd-8b04a7b1adc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bfbc3fdd-000a-4a7e-97fa-608fdff52335 tempest-VolumesListTestJSON-1122791419 None] Created volume successfully.
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Flow 'volume_create_manager' (ee985a8f-0cde-4676-ad10-d87e66fe9a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45016dac-5de3-4b55-a7b9-c58bb56072ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45016dac-5de3-4b55-a7b9-c58bb56072ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1547885756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9be70a5-fb0c-4e8a-8062-b33ca5928720,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b517c223397c4d099902d0cc399e9d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:19Z,use_quota=True,user_id='60f37efee8914513a83e8091f61a4de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85c6367-ec1f-4eff-9251-d5af132b1e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85c6367-ec1f-4eff-9251-d5af132b1e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f53242a-f7bd-4a8c-b692-c734d9dd7378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f53242a-f7bd-4a8c-b692-c734d9dd7378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9be70a5-fb0c-4e8a-8062-b33ca5928720', 'volume_name': 'volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702b328a-7d81-4510-bbdb-2aa26490cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702b328a-7d81-4510-bbdb-2aa26490cf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24095f38-d317-422b-86d5-1e7553a24b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Volume e9be70a5-fb0c-4e8a-8062-b33ca5928720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720', 'volume_size': 1}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1547885756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9be70a5-fb0c-4e8a-8062-b33ca5928720,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b517c223397c4d099902d0cc399e9d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:19Z,use_quota=True,user_id='60f37efee8914513a83e8091f61a4de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Creating volume e9be70a5-fb0c-4e8a-8062-b33ca5928720 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:19 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:19 devstack sudo[94031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720 1073741824
Nov 05 03:48:19 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:19 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720 1073741824" returned: 0 in 0.627s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:19 devstack sudo[94040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720
Nov 05 03:48:19 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:20 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24095f38-d317-422b-86d5-1e7553a24b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd95c799-684a-4eb4-bbd3-59a75a34468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Volume volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720 (e9be70a5-fb0c-4e8a-8062-b33ca5928720): created successfully
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd95c799-684a-4eb4-bbd3-59a75a34468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Flow 'volume_create_manager' (ee985a8f-0cde-4676-ad10-d87e66fe9a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3604c43d-e279-4ed3-8e82-6d4cf654868c tempest-VolumesListTestJSON-1122791419 None] Created volume successfully.
Nov 05 03:48:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-87f10ad0-f206-4224-a2b8-ba4d607e7016 tempest-ServerActionsTestOtherA-1465707758 None] Terminate volume connection completed successfully.
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-87f10ad0-f206-4224-a2b8-ba4d607e7016 tempest-ServerActionsTestOtherA-1465707758 None] Deleting attachment af0e987f-21db-4eb8-b057-ccb7140aa728. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "cinder-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "cinder-quobyte-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-quobyte-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f8bc6-e746-4ac5-ac84-c98992543a55]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:20 devstack sudo[94045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d
Nov 05 03:48:20 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:21 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d" returned: 0 in 1.022s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:21 devstack sudo[94104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d
Nov 05 03:48:21 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "cinder-c296aabe-4e67-4402-96e1-9098aa6332d9-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-c296aabe-4e67-4402-96e1-9098aa6332d9-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "cinder-quobyte-c296aabe-4e67-4402-96e1-9098aa6332d9" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-quobyte-c296aabe-4e67-4402-96e1-9098aa6332d9" acquired by "delete_volume" :: waited 0.044s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fbe077-4769-4e93-97a0-9e14cce0f8fa]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:22 devstack sudo[94116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9
Nov 05 03:48:22 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:22 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d" returned: 0 in 0.847s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-quobyte-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d" released by "delete_volume" :: held 1.931s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.quota [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Created reservations ['026f5c8b-0c79-473d-8d3a-d38a36e0bfb6', '9f36d82d-ff34-43f7-adea-968efd5afdce', 'a3083f52-0541-4372-9c52-56eca134c0e7', '9803fabb-2b16-449d-854f-0aa8cd241a94'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:22 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:22 devstack sudo[94125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:22 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Flow 'volume_create_manager' (74a67eae-e226-4488-a90f-0063aeabe577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8574afdd-5bc9-467f-8eff-eff0e9fb8d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9" returned: 0 in 0.709s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8574afdd-5bc9-467f-8eff-eff0e9fb8d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-348183870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e66a59d-b654-4109-aa7c-87fa09cfa82c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b517c223397c4d099902d0cc399e9d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:23Z,use_quota=True,user_id='60f37efee8914513a83e8091f61a4de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:22 devstack sudo[94127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284be329-a365-4dda-96e0-c0b62c7f3588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:22 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284be329-a365-4dda-96e0-c0b62c7f3588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ef49dc-337d-4ef8-9fed-849316ba401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ef49dc-337d-4ef8-9fed-849316ba401f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e66a59d-b654-4109-aa7c-87fa09cfa82c', 'volume_name': 'volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203e84f7-d5e9-4d4b-85e4-d1b5c1fce020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203e84f7-d5e9-4d4b-85e4-d1b5c1fce020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4a6db9-451a-4f8d-a6a5-a385198bb495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Volume 6e66a59d-b654-4109-aa7c-87fa09cfa82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c', 'volume_size': 1}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-348183870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e66a59d-b654-4109-aa7c-87fa09cfa82c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b517c223397c4d099902d0cc399e9d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:23Z,use_quota=True,user_id='60f37efee8914513a83e8091f61a4de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Creating volume 6e66a59d-b654-4109-aa7c-87fa09cfa82c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:48:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:23 devstack sudo[94131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c 1073741824
Nov 05 03:48:23 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:23 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.427s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG cinder.manager [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Deleted volume successfully.
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-4947c3f9-cfae-4f2f-a7bb-134606dc741f req-b48ca812-c77c-45ea-b80b-fefe9213194b tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-ebd9d531-ed4b-4a4b-a432-a335fc1d4c9d-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:23 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c296aabe-4e67-4402-96e1-9098aa6332d9" returned: 0 in 0.647s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-quobyte-c296aabe-4e67-4402-96e1-9098aa6332d9" released by "delete_volume" :: held 1.480s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Created reservations ['387a6a89-6ab5-4e1c-88e0-5485da753d84', 'd00fae38-102b-4e50-be3d-3af5012f5892', 'f85a2939-ad72-4e89-a6c8-d5eb5f140c37', 'dfced228-7e3c-4018-9905-a61e39817bbf'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:23 devstack sudo[94139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:23 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:23 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c 1073741824" returned: 0 in 0.880s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:23 devstack sudo[94141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c
Nov 05 03:48:23 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:24 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Deleted volume successfully.
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e9d51517-9236-401a-9b7e-e187bf9636b2 tempest-ServerActionsTestOtherA-1465707758 None] Lock "cinder-c296aabe-4e67-4402-96e1-9098aa6332d9-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:24 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4a6db9-451a-4f8d-a6a5-a385198bb495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d276722-58fc-4118-b610-b2772a1c8b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Volume volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c (6e66a59d-b654-4109-aa7c-87fa09cfa82c): created successfully
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d276722-58fc-4118-b610-b2772a1c8b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Flow 'volume_create_manager' (74a67eae-e226-4488-a90f-0063aeabe577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e85308fa-046c-48a0-9699-a6bb7288fb13 tempest-VolumesListTestJSON-1122791419 None] Created volume successfully.
Nov 05 03:48:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "cinder-6e66a59d-b654-4109-aa7c-87fa09cfa82c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-6e66a59d-b654-4109-aa7c-87fa09cfa82c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:28 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=80,cinder:SELECT=79,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:48:28 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=91,cinder:SELECT=76,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:48:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "cinder-quobyte-6e66a59d-b654-4109-aa7c-87fa09cfa82c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-quobyte-6e66a59d-b654-4109-aa7c-87fa09cfa82c" acquired by "delete_volume" :: waited 0.041s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f5d15-c9d1-42f1-915a-fb42906c5090]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:29 devstack sudo[94178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c
Nov 05 03:48:29 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:29 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c" returned: 0 in 0.644s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:29 devstack sudo[94183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c
Nov 05 03:48:29 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Flow 'volume_create_manager' (c9ff6498-bb76-4cbf-a86f-37d659bb4801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc911dec-e0f8-4879-9a20-70016b0f18a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc911dec-e0f8-4879-9a20-70016b0f18a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1677610096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d9a209-7909-4bfc-a384-837b851ac9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6052e12620fd403f98aef6e8c2462410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:30Z,use_quota=True,user_id='59d9c281b6cc4d0d89d408747bbcc163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1ed344-d651-45d7-915c-b7f9e8eed414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1ed344-d651-45d7-915c-b7f9e8eed414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa542e9-e7ed-4e3e-a6c1-7c910cba7c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa542e9-e7ed-4e3e-a6c1-7c910cba7c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d9a209-7909-4bfc-a384-837b851ac9a2', 'volume_name': 'volume-e3d9a209-7909-4bfc-a384-837b851ac9a2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944bfea6-e4e5-405b-b370-8aa9ef4e3781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944bfea6-e4e5-405b-b370-8aa9ef4e3781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214e3d1b-33e3-41fd-bfad-9e13dbea3969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:29 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Volume e3d9a209-7909-4bfc-a384-837b851ac9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d9a209-7909-4bfc-a384-837b851ac9a2', 'volume_size': 1}
Nov 05 03:48:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1677610096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d9a209-7909-4bfc-a384-837b851ac9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6052e12620fd403f98aef6e8c2462410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:30Z,use_quota=True,user_id='59d9c281b6cc4d0d89d408747bbcc163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Creating volume e3d9a209-7909-4bfc-a384-837b851ac9a2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:30 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:30 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6e66a59d-b654-4109-aa7c-87fa09cfa82c" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:30 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2 1073741824
Nov 05 03:48:30 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-quobyte-6e66a59d-b654-4109-aa7c-87fa09cfa82c" released by "delete_volume" :: held 1.043s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Created reservations ['3723629a-d3f3-4aad-bb76-5ddd3ff6c613', '4e93f14f-ace6-4c15-86c5-9667d374bf3e', 'f4770491-3375-49fc-a12c-6a505efe541a', '2af501a2-3846-49bb-b1d5-1ea15201b4cc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:30 devstack sudo[94188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:30 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:30 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2 1073741824" returned: 0 in 0.549s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:30 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Deleted volume successfully.
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e07f3596-0999-4398-a0f3-437da245a4e4 tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-6e66a59d-b654-4109-aa7c-87fa09cfa82c-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:30 devstack sudo[94195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2
Nov 05 03:48:30 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:30 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214e3d1b-33e3-41fd-bfad-9e13dbea3969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d9a209-7909-4bfc-a384-837b851ac9a2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8760b13-479f-495b-a85d-6745f1b1d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:30 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Volume volume-e3d9a209-7909-4bfc-a384-837b851ac9a2 (e3d9a209-7909-4bfc-a384-837b851ac9a2): created successfully
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8760b13-479f-495b-a85d-6745f1b1d59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Flow 'volume_create_manager' (c9ff6498-bb76-4cbf-a86f-37d659bb4801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d5f8b09f-66f7-42a3-80b6-d599d11f4e41 tempest-AttachVolumeTestJSON-1222244080 None] Created volume successfully.
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "cinder-e9be70a5-fb0c-4e8a-8062-b33ca5928720-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-e9be70a5-fb0c-4e8a-8062-b33ca5928720-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "cinder-quobyte-e9be70a5-fb0c-4e8a-8062-b33ca5928720" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-quobyte-e9be70a5-fb0c-4e8a-8062-b33ca5928720" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed61a5e-2455-4b37-a678-f066cc36c5ab]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:31 devstack sudo[94198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720
Nov 05 03:48:31 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:31 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:31 devstack sudo[94203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720
Nov 05 03:48:31 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:32 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e9be70a5-fb0c-4e8a-8062-b33ca5928720" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-quobyte-e9be70a5-fb0c-4e8a-8062-b33ca5928720" released by "delete_volume" :: held 0.800s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Created reservations ['47496144-d161-41f3-9329-8c2d307d61c3', '261c231b-21a5-4999-b6d0-77f007439197', '670fde9f-ad4b-4a61-ba09-3545b43a576a', '75bd8fc2-e971-4857-956b-0438a63d69ea'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:32 devstack sudo[94211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:32 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "cinder-a0de2efb-cd6f-4c97-8a27-f4121f100439-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-a0de2efb-cd6f-4c97-8a27-f4121f100439-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "cinder-quobyte-a0de2efb-cd6f-4c97-8a27-f4121f100439" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-quobyte-a0de2efb-cd6f-4c97-8a27-f4121f100439" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ff89c4-6487-45af-a42a-bdfe9ff9d735]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:32 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.574s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Deleted volume successfully.
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f105897a-fe99-470e-b862-36087ace5a3a tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-e9be70a5-fb0c-4e8a-8062-b33ca5928720-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:33 devstack sudo[94214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439
Nov 05 03:48:33 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-82321807-0fb4-40de-a5ea-a6f3f33d9baf req-42926a4d-44b3-4053-94bc-5dc3b9c8d377 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-82321807-0fb4-40de-a5ea-a6f3f33d9baf req-42926a4d-44b3-4053-94bc-5dc3b9c8d377 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-82321807-0fb4-40de-a5ea-a6f3f33d9baf req-42926a4d-44b3-4053-94bc-5dc3b9c8d377 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-82321807-0fb4-40de-a5ea-a6f3f33d9baf req-42926a4d-44b3-4053-94bc-5dc3b9c8d377 tempest-AttachVolumeTestJSON-1222244080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-e3d9a209-7909-4bfc-a384-837b851ac9a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fea9900-8445-4db7-9d16-50ba640d4e05', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:48:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-82321807-0fb4-40de-a5ea-a6f3f33d9baf req-42926a4d-44b3-4053-94bc-5dc3b9c8d377 tempest-AttachVolumeTestJSON-1222244080 None] attachment_update completed successfully.
Nov 05 03:48:33 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439" returned: 0 in 0.542s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:33 devstack sudo[94229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439
Nov 05 03:48:33 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:33 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a0de2efb-cd6f-4c97-8a27-f4121f100439" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-quobyte-a0de2efb-cd6f-4c97-8a27-f4121f100439" released by "delete_volume" :: held 0.942s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Created reservations ['c5f0c678-1102-43d0-8246-70760e1ab66f', '2ae5ed2b-d7b7-4bfd-acfd-29a22a67c654', '61f40426-a408-4b09-9dc7-5933d1a4a470', 'dfd26497-f53e-4132-8410-3f6cfb653856'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:33 devstack sudo[94652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:33 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:34 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.467s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:34 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Deleted volume successfully.
Nov 05 03:48:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12ba317f-eb73-4420-abf2-d2348cf629fa tempest-VolumesListTestJSON-1122791419 None] Lock "cinder-a0de2efb-cd6f-4c97-8a27-f4121f100439-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Flow 'volume_create_manager' (e2ac6f06-1825-43dc-a700-cf140ced31f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbabee6a-56ae-46c2-ad14-d2378df77013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbabee6a-56ae-46c2-ad14-d2378df77013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-758128575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d10224-cf9f-4f0b-b427-3f95698eaf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='748736059faa405c8447556a791d9706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:41Z,use_quota=True,user_id='96f50fde56a44dafa19691efeb465fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2783824-54e4-4e15-91b5-2ac475455dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2783824-54e4-4e15-91b5-2ac475455dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84f99c3-edd4-4517-9b81-d4cc40d254b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84f99c3-edd4-4517-9b81-d4cc40d254b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d10224-cf9f-4f0b-b427-3f95698eaf9e', 'volume_name': 'volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc05a45-2442-4a2f-b0e5-75d19237b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc05a45-2442-4a2f-b0e5-75d19237b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9923a5f2-ce4e-4a80-8f50-10ed584787a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e', 'volume_size': 1}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-758128575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d10224-cf9f-4f0b-b427-3f95698eaf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='748736059faa405c8447556a791d9706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:41Z,use_quota=True,user_id='96f50fde56a44dafa19691efeb465fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Creating volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:41 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:48:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:41 devstack sudo[95254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e 1073741824
Nov 05 03:48:41 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:42 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e 1073741824" returned: 0 in 0.695s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:42 devstack sudo[95264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e
Nov 05 03:48:42 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:42 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e" returned: 0 in 0.372s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9923a5f2-ce4e-4a80-8f50-10ed584787a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba93296-e667-49d7-8b59-db7825eb3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Volume volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e (16d10224-cf9f-4f0b-b427-3f95698eaf9e): created successfully
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba93296-e667-49d7-8b59-db7825eb3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Flow 'volume_create_manager' (e2ac6f06-1825-43dc-a700-cf140ced31f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bd3bcb85-cec1-4155-9997-6de627b45518 tempest-VolumesSnapshotListTestJSON-824837871 None] Created volume successfully.
Nov 05 03:48:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cdc8b5c9-8f41-4a36-a43a-bab65309c873 tempest-GroupsV320Test-134053308 None] Group tempest-GroupsV320Test-Group-1071372743: creating
Nov 05 03:48:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cdc8b5c9-8f41-4a36-a43a-bab65309c873 tempest-GroupsV320Test-134053308 None] Group tempest-GroupsV320Test-Group-1071372743: created successfully
Nov 05 03:48:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cdc8b5c9-8f41-4a36-a43a-bab65309c873 tempest-GroupsV320Test-134053308 None] Create group completed successfully.
Nov 05 03:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Creating offline snapshot 18096199-3175-4d5d-b261-985f7434d359 of volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:48:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[782b95dd-b256-41b0-9ce9-aec6179ebb4a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:43 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e
Nov 05 03:48:43 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:44 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e" returned: 0 in 0.482s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:44 devstack sudo[95273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 1G
Nov 05 03:48:44 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:44 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 1G" returned: 0 in 0.557s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:44 devstack sudo[95279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359
Nov 05 03:48:44 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Created reservations ['d0cc2930-0697-41fd-b058-f2e769d41536'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:45 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:48:45 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:45 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:45 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 is being set with open permissions: ugo+rw
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:45 devstack sudo[95287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359
Nov 05 03:48:45 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:45 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e25065e6-e4af-440e-b1f5-50e494368c27 tempest-GroupsV320Test-134053308 None] Delete group completed successfully.
Nov 05 03:48:45 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:45 devstack sudo[95291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.info
Nov 05 03:48:45 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:45 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.info" returned: 0 in 0.272s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:45 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.info is being set with open permissions: ugo+rw
Nov 05 03:48:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:45 devstack sudo[95294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.info
Nov 05 03:48:45 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:46 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.info" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f2d2b11b-db26-432d-86ce-126c8323cd91 tempest-VolumesSnapshotListTestJSON-824837871 None] Create snapshot completed successfully
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Creating offline snapshot 6f7bb864-43a6-43e2-8838-a5021fcf57c2 of volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3811449d-d65b-4d4b-9b3e-a207d69e7131]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:47 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359
Nov 05 03:48:47 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:47 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:48:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:47 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 1G
Nov 05 03:48:47 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:48 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 1G" returned: 0 in 0.619s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:48 devstack sudo[95311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2
Nov 05 03:48:48 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:48 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2" returned: 0 in 0.483s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:48 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 is being set with open permissions: ugo+rw
Nov 05 03:48:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:48 devstack sudo[95317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2
Nov 05 03:48:48 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Flow 'volume_create_manager' (648ad7ac-f4e7-4a90-b44d-e11ecd9a060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7fbee1-e01c-4612-bd33-0d6336cd1c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7fbee1-e01c-4612-bd33-0d6336cd1c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1994035741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab3065b-12c8-4cd5-8b4a-b04ce96de0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ccd832c08344bbb560bec09785e5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:49Z,use_quota=True,user_id='bb42643bf18d4f9981ac0fe9acb3d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4bcfc0-6baa-4ca2-b3d2-c8c3bf2006a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4bcfc0-6baa-4ca2-b3d2-c8c3bf2006a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0047a9-84b5-4c49-9c57-39879b4c2fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0047a9-84b5-4c49-9c57-39879b4c2fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab3065b-12c8-4cd5-8b4a-b04ce96de0b1', 'volume_name': 'volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:49 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1344c6d6-501d-4960-ace6-8dfff28a4ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1344c6d6-501d-4960-ace6-8dfff28a4ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5db5e8-8874-4cec-a464-95bb49522894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Volume cab3065b-12c8-4cd5-8b4a-b04ce96de0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1', 'volume_size': 1}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1994035741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab3065b-12c8-4cd5-8b4a-b04ce96de0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ccd832c08344bbb560bec09785e5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:49Z,use_quota=True,user_id='bb42643bf18d4f9981ac0fe9acb3d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Creating volume cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:49 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:48:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:49 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 1073741824
Nov 05 03:48:49 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bde80ef8-e12b-4e13-8889-5055167f3bac tempest-VolumesSnapshotListTestJSON-824837871 None] Create snapshot completed successfully
Nov 05 03:48:50 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 1073741824" returned: 0 in 0.747s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:50 devstack sudo[95342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1
Nov 05 03:48:50 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:50 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5db5e8-8874-4cec-a464-95bb49522894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683a7c0b-4d46-4bed-96a5-381fff99582d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Volume volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 (cab3065b-12c8-4cd5-8b4a-b04ce96de0b1): created successfully
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683a7c0b-4d46-4bed-96a5-381fff99582d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Flow 'volume_create_manager' (648ad7ac-f4e7-4a90-b44d-e11ecd9a060a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5864b8a9-2487-43cc-97c0-aad4acca81c2 tempest-AttachVolumeNegativeTest-256552439 None] Created volume successfully.
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Creating offline snapshot afc578f1-124d-417d-8d1c-3bbe1378df35 of volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[09046dab-8ba2-4165-b4c5-5f67ff9557fe]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:50 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2
Nov 05 03:48:50 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:51 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2" returned: 0 in 0.563s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:48:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:51 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 1G
Nov 05 03:48:51 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:52 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 1G" returned: 0 in 0.772s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:52 devstack sudo[95361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35
Nov 05 03:48:52 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-bc84c1ac-2e6a-453a-95d1-c4f20080b383 req-b806fd2b-914e-4cc5-9229-9d04b69256f6 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:52 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35" returned: 0 in 0.440s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:52 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 is being set with open permissions: ugo+rw
Nov 05 03:48:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:52 devstack sudo[95375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35
Nov 05 03:48:52 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:52 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-bc84c1ac-2e6a-453a-95d1-c4f20080b383 req-b806fd2b-914e-4cc5-9229-9d04b69256f6 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.475s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-bc84c1ac-2e6a-453a-95d1-c4f20080b383 req-b806fd2b-914e-4cc5-9229-9d04b69256f6 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8359c15e-0734-4816-a32e-2a504ae9d4d1 tempest-VolumesSnapshotListTestJSON-824837871 None] Create snapshot completed successfully
Nov 05 03:48:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-bc84c1ac-2e6a-453a-95d1-c4f20080b383 req-b806fd2b-914e-4cc5-9229-9d04b69256f6 tempest-AttachVolumeNegativeTest-256552439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8eafd3c-2772-4bf2-a190-08be1de05766', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:48:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-bc84c1ac-2e6a-453a-95d1-c4f20080b383 req-b806fd2b-914e-4cc5-9229-9d04b69256f6 tempest-AttachVolumeNegativeTest-256552439 None] attachment_update completed successfully.
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-afc578f1-124d-417d-8d1c-3bbe1378df35-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-afc578f1-124d-417d-8d1c-3bbe1378df35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-quobyte-afc578f1-124d-417d-8d1c-3bbe1378df35" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-afc578f1-124d-417d-8d1c-3bbe1378df35" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Deleting offline snapshot afc578f1-124d-417d-8d1c-3bbe1378df35 of volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] snapshot_file for this snap is: volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde5939d-dff9-40a5-8b72-b0fdd00cc35e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:55 devstack sudo[95389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35
Nov 05 03:48:55 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ac9d9370-5fda-4fbb-944e-6e14367cbe63 req-7b228a63-8f2e-41ec-b3c7-fc7439109c70 tempest-AttachVolumeNegativeTest-256552439 None] Terminate volume connection completed successfully.
Nov 05 03:48:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ac9d9370-5fda-4fbb-944e-6e14367cbe63 req-7b228a63-8f2e-41ec-b3c7-fc7439109c70 tempest-AttachVolumeNegativeTest-256552439 None] Deleting attachment a8eafd3c-2772-4bf2-a190-08be1de05766. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:48:56 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35" returned: 0 in 0.630s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:48:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db45d3a-9a5a-4b1c-9b1c-9ee015c297da]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:56 devstack sudo[95396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2
Nov 05 03:48:56 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:56 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2" returned: 0 in 0.653s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:48:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:56 devstack sudo[95401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35
Nov 05 03:48:56 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:57 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35" returned: 0 in 0.890s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:57 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35
Nov 05 03:48:57 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:58 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.afc578f1-124d-417d-8d1c-3bbe1378df35" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-afc578f1-124d-417d-8d1c-3bbe1378df35" released by "_delete_snapshot" :: held 2.855s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" released by "delete_snapshot" :: held 2.908s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Created reservations ['91aa798d-c305-44ff-8d53-037acb31b0c1', '0288e2b9-95bc-4b72-9da9-b24c49988637', '376b15c1-381a-4d44-b1e8-2d0250b60d70', '03cec98f-8d9b-4a36-bfd2-1749caed0cd6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Delete snapshot completed successfully.
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2919eb9f-9bef-45e2-9ed0-615a58c73331 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-afc578f1-124d-417d-8d1c-3bbe1378df35-delete_snapshot" released by "delete_snapshot" :: held 3.139s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-6f7bb864-43a6-43e2-8838-a5021fcf57c2-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-6f7bb864-43a6-43e2-8838-a5021fcf57c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-quobyte-6f7bb864-43a6-43e2-8838-a5021fcf57c2" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-6f7bb864-43a6-43e2-8838-a5021fcf57c2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Deleting offline snapshot 6f7bb864-43a6-43e2-8838-a5021fcf57c2 of volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] snapshot_file for this snap is: volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1fe505-067f-4c8b-8083-b0ff9397a566]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:58 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2
Nov 05 03:48:58 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:59 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2" returned: 0 in 0.483s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:48:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a07fbe7-4ca2-4684-86b5-00ad515c4fae]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:59 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359
Nov 05 03:48:59 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:59 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359" returned: 0 in 0.500s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:48:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:59 devstack sudo[95470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2
Nov 05 03:48:59 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:00 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2" returned: 0 in 0.620s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:00 devstack sudo[95477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2
Nov 05 03:49:00 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:00 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.6f7bb864-43a6-43e2-8838-a5021fcf57c2" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-6f7bb864-43a6-43e2-8838-a5021fcf57c2" released by "_delete_snapshot" :: held 2.147s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" released by "delete_snapshot" :: held 2.191s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:00 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Created reservations ['22e2c08a-0495-4ac4-a3b6-d2aa1c311459', '618c5183-19ff-4740-bb1f-4f83fb78b186', '12e96773-9c52-4e3b-b134-f8283b6727e8', '244a1311-976f-486f-90ea-2541970b3d5e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Delete snapshot completed successfully.
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3d65fe4-4495-4e77-80d2-7511cabc9e47 tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-6f7bb864-43a6-43e2-8838-a5021fcf57c2-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-18096199-3175-4d5d-b261-985f7434d359-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-18096199-3175-4d5d-b261-985f7434d359-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-quobyte-18096199-3175-4d5d-b261-985f7434d359" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-18096199-3175-4d5d-b261-985f7434d359" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Deleting offline snapshot 18096199-3175-4d5d-b261-985f7434d359 of volume 16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] snapshot_file for this snap is: volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12cfea2-b2e9-4e5e-a548-d33a35e7b7f6]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:02 devstack sudo[95480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359
Nov 05 03:49:02 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:02 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359" returned: 0 in 0.586s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:49:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d3a42-cf3f-4e9d-a977-e64fbaab32ee]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:02 devstack sudo[95485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e
Nov 05 03:49:02 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:03 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e" returned: 0 in 0.663s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:03 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359
Nov 05 03:49:03 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "cinder-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:03 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359" returned: 0 in 0.574s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:03 devstack sudo[95499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359
Nov 05 03:49:03 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "cinder-quobyte-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-quobyte-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cbbbdf-d2e9-482a-b9e5-2fcba40f030c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:04 devstack sudo[95501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1
Nov 05 03:49:04 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:04 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e.18096199-3175-4d5d-b261-985f7434d359" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-18096199-3175-4d5d-b261-985f7434d359" released by "_delete_snapshot" :: held 2.334s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" released by "delete_snapshot" :: held 2.372s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-1e7b6150-18af-4fe5-8038-9b7eb4ccb868 req-3d9d83a2-1368-4c6e-bd87-275140667ac0 tempest-AttachVolumeTestJSON-1222244080 None] Terminate volume connection completed successfully.
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-1e7b6150-18af-4fe5-8038-9b7eb4ccb868 req-3d9d83a2-1368-4c6e-bd87-275140667ac0 tempest-AttachVolumeTestJSON-1222244080 None] Deleting attachment 4fea9900-8445-4db7-9d16-50ba640d4e05. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Created reservations ['7c308d88-e447-4bae-915f-79aa8a15c575', '4089dd28-2b98-40f0-9c29-7250fb08df6b', 'ab880cbd-fae3-4577-86c6-f42b1d02b74f', '72dffd4a-96aa-44d6-8e49-2f0f904d2c05'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Delete snapshot completed successfully.
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4bb1490b-a63f-4884-9e06-6ae08db6a6eb tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-18096199-3175-4d5d-b261-985f7434d359-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:04 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1" returned: 0 in 0.585s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:04 devstack sudo[95511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1
Nov 05 03:49:04 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:04 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1" returned: 0 in 0.254s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-quobyte-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1" released by "delete_volume" :: held 0.895s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Created reservations ['8a9f626b-eff4-481e-9db5-e2bcc01a64ca', '2796e8f4-eafb-4ef9-ac13-b132d38777fc', 'e6e8a81d-a328-411e-ae9d-9cfe64182835', '0c98bdb4-667e-4453-9df2-54ba3d01b3c0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:05 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:05 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-16d10224-cf9f-4f0b-b427-3f95698eaf9e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "cinder-cf944060-30b8-4729-8b8a-75c3d0cd8b5b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:05 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-16d10224-cf9f-4f0b-b427-3f95698eaf9e-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Deleted volume successfully.
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-cf944060-30b8-4729-8b8a-75c3d0cd8b5b-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-782a6cb3-8ec6-425f-b76d-bd7c48190e3c tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-cab3065b-12c8-4cd5-8b4a-b04ce96de0b1-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "cinder-quobyte-cf944060-30b8-4729-8b8a-75c3d0cd8b5b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-quobyte-cf944060-30b8-4729-8b8a-75c3d0cd8b5b" acquired by "delete_volume" :: waited 0.049s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Flow 'volume_create_manager' (b3d288c9-779f-4950-a736-fa908d223d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2b2feb-4a5b-4a56-9ead-6b2db7852dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a6c7a3-b8ec-4f67-9141-c9c93312e140]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c65f14-4935-44eb-a505-2662f45b5381]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2b2feb-4a5b-4a56-9ead-6b2db7852dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1048458534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4766363c-3e56-4c82-b082-6db46597d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5fddb6518949fea863dc6f29727192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:06Z,use_quota=True,user_id='1a21b29c0a46471a8f76c699fc25aa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b609686-5d3f-48a3-8508-d28d5d572dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b609686-5d3f-48a3-8508-d28d5d572dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02131d49-364f-4c4b-a3a3-96b5d927a6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02131d49-364f-4c4b-a3a3-96b5d927a6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4766363c-3e56-4c82-b082-6db46597d13a', 'volume_name': 'volume-4766363c-3e56-4c82-b082-6db46597d13a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df404909-214b-4f6e-9464-a5bdefaaf498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df404909-214b-4f6e-9464-a5bdefaaf498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e805c10c-b569-41fd-9355-cad4a6c9fdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Volume 4766363c-3e56-4c82-b082-6db46597d13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4766363c-3e56-4c82-b082-6db46597d13a', 'volume_size': 1}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1048458534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4766363c-3e56-4c82-b082-6db46597d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5fddb6518949fea863dc6f29727192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:06Z,use_quota=True,user_id='1a21b29c0a46471a8f76c699fc25aa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Creating volume 4766363c-3e56-4c82-b082-6db46597d13a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:49:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:05 devstack sudo[95522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e
Nov 05 03:49:05 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:05 devstack sudo[95524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a 1073741824
Nov 05 03:49:05 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:05 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b
Nov 05 03:49:05 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:06 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:06 devstack sudo[95540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b
Nov 05 03:49:06 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack sudo[95541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e
Nov 05 03:49:06 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a 1073741824" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:06 devstack sudo[95544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a
Nov 05 03:49:06 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf944060-30b8-4729-8b8a-75c3d0cd8b5b" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-16d10224-cf9f-4f0b-b427-3f95698eaf9e" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-quobyte-cf944060-30b8-4729-8b8a-75c3d0cd8b5b" released by "delete_volume" :: held 0.736s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-quobyte-16d10224-cf9f-4f0b-b427-3f95698eaf9e" released by "delete_volume" :: held 0.776s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Created reservations ['5856de03-5917-4c40-9880-13502a602678', '82fa215e-c123-4031-bc0c-838ee86839bb', '4116dcd8-301e-43a9-81c1-e231c1eca5a4', '4bc8be23-e495-4d44-a6ae-c4338733251e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Created reservations ['4a9ca244-6cd6-4f66-b9f3-458d46009758', '13ae1b4f-4e66-443b-9395-6a7826dae11e', '1201565a-76c7-4701-9f57-6784ddbf2e35', '7199f5a7-cca8-406d-b282-fd54c187ef58'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:06 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:06 devstack sudo[95549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:06 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e805c10c-b569-41fd-9355-cad4a6c9fdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4766363c-3e56-4c82-b082-6db46597d13a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b28fda-4152-4969-b8f6-bfabb58824a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Volume volume-4766363c-3e56-4c82-b082-6db46597d13a (4766363c-3e56-4c82-b082-6db46597d13a): created successfully
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b28fda-4152-4969-b8f6-bfabb58824a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Flow 'volume_create_manager' (b3d288c9-779f-4950-a736-fa908d223d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4b01c764-2c77-4a1b-9c7f-1706a2c6376c tempest-VolumeQuotasAdminTestJSON-407318376 None] Created volume successfully.
Nov 05 03:49:06 devstack sudo[95551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:06 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.318s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "cinder-d8eacff4-320e-44c0-b392-519471ce7467-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Deleted volume successfully.
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-d8eacff4-320e-44c0-b392-519471ce7467-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd658c62-493e-43de-832f-fa9a2eb4c9ff tempest-VolumesSnapshotListTestJSON-824837871 None] Lock "cinder-16d10224-cf9f-4f0b-b427-3f95698eaf9e-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "cinder-quobyte-d8eacff4-320e-44c0-b392-519471ce7467" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:07 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-quobyte-d8eacff4-320e-44c0-b392-519471ce7467" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Deleted volume successfully.
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb9bece-c05f-42b0-9a88-1c77834d88e7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a0d71148-e471-4ddd-8124-54b0021e1289 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-cf944060-30b8-4729-8b8a-75c3d0cd8b5b-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:07 devstack sudo[95555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467
Nov 05 03:49:07 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:07 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467" returned: 0 in 0.397s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:07 devstack sudo[95560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467
Nov 05 03:49:07 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Acquiring lock "cinder-4766363c-3e56-4c82-b082-6db46597d13a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "cinder-4766363c-3e56-4c82-b082-6db46597d13a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:07 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8eacff4-320e-44c0-b392-519471ce7467" returned: 0 in 0.353s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-quobyte-d8eacff4-320e-44c0-b392-519471ce7467" released by "delete_volume" :: held 0.872s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Acquiring lock "cinder-quobyte-4766363c-3e56-4c82-b082-6db46597d13a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "cinder-quobyte-4766363c-3e56-4c82-b082-6db46597d13a" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[420b3007-4a78-4ea7-bef0-5e2f61886519]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Created reservations ['f81f1b9e-f2ec-42f8-8872-9e5dad4d810b', 'c1b7ded8-de90-453a-b007-b65af2a7910b', '4908b2e6-a7f8-45c2-8c52-69c38bbeed6a', '867d866b-c140-4e7f-9d66-21bb009958aa'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:08 devstack sudo[95574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a
Nov 05 03:49:08 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:08 devstack sudo[95582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:08 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:08 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.398s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:08 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Deleted volume successfully.
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a" returned: 0 in 0.675s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9006460a-fca4-47c3-baf5-21435775d7d1 tempest-AttachVolumeNegativeTest-256552439 None] Lock "cinder-d8eacff4-320e-44c0-b392-519471ce7467-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:08 devstack sudo[95595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a
Nov 05 03:49:08 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:09 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4766363c-3e56-4c82-b082-6db46597d13a" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "cinder-quobyte-4766363c-3e56-4c82-b082-6db46597d13a" released by "delete_volume" :: held 1.144s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Created reservations ['66571944-7f96-457c-98f4-a1694ed2b482', '10e8ef4c-c5a4-4e01-b4b7-1792741cebce', 'ee7b360e-7908-4bf9-84fa-d41a576518a9', '1e274b60-ffec-47fa-8576-c521a5092673'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:09 devstack sudo[95624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:09 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:09 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Deleted volume successfully.
Nov 05 03:49:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-61ec372a-2581-45a9-91da-90ecfa2940ab tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "cinder-4766363c-3e56-4c82-b082-6db46597d13a-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:10 devstack sudo[95671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:10 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:10 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.302s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:49:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Flow 'volume_create_manager' (dabf143d-aefd-4f32-8ca6-85a6d1bfb640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc9d49d-6e92-41f9-a69a-355b8eb97ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc9d49d-6e92-41f9-a69a-355b8eb97ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1298226372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8240afd-beaf-4dd1-be72-1cb56c95d016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5fddb6518949fea863dc6f29727192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:11Z,use_quota=True,user_id='1a21b29c0a46471a8f76c699fc25aa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b953f1-9ecd-4a7e-b956-cf56769ff7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b953f1-9ecd-4a7e-b956-cf56769ff7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1220c587-5d77-4a15-8658-42de292de704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1220c587-5d77-4a15-8658-42de292de704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8240afd-beaf-4dd1-be72-1cb56c95d016', 'volume_name': 'volume-f8240afd-beaf-4dd1-be72-1cb56c95d016', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe899fe-abd4-4e9b-af66-b1564bc255e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe899fe-abd4-4e9b-af66-b1564bc255e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8720578d-7a7a-42ba-962b-fe24744b6131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:11 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Volume f8240afd-beaf-4dd1-be72-1cb56c95d016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8240afd-beaf-4dd1-be72-1cb56c95d016', 'volume_size': 1}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1298226372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8240afd-beaf-4dd1-be72-1cb56c95d016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5fddb6518949fea863dc6f29727192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:11Z,use_quota=True,user_id='1a21b29c0a46471a8f76c699fc25aa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Creating volume f8240afd-beaf-4dd1-be72-1cb56c95d016 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:11 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:49:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:11 devstack sudo[95677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016 1073741824
Nov 05 03:49:11 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:12 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016 1073741824" returned: 0 in 0.645s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:12 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016
Nov 05 03:49:12 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:12 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8720578d-7a7a-42ba-962b-fe24744b6131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8240afd-beaf-4dd1-be72-1cb56c95d016', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12d219d-cd2c-49c4-87d2-b8bd19e90fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Volume volume-f8240afd-beaf-4dd1-be72-1cb56c95d016 (f8240afd-beaf-4dd1-be72-1cb56c95d016): created successfully
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12d219d-cd2c-49c4-87d2-b8bd19e90fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Flow 'volume_create_manager' (dabf143d-aefd-4f32-8ca6-85a6d1bfb640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-556e6c6f-e2b0-4de8-bc3f-6e8c9deaf453 tempest-VolumeQuotasAdminTestJSON-407318376 None] Created volume successfully.
Nov 05 03:49:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a1b23158-12db-427a-8bdc-08083fabce14 tempest-VolumeQuotasAdminTestJSON-1636436233 None] Transfer volume completed successfully.
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Acquiring lock "cinder-f8240afd-beaf-4dd1-be72-1cb56c95d016-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Lock "cinder-f8240afd-beaf-4dd1-be72-1cb56c95d016-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Acquiring lock "cinder-quobyte-f8240afd-beaf-4dd1-be72-1cb56c95d016" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Lock "cinder-quobyte-f8240afd-beaf-4dd1-be72-1cb56c95d016" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[364cf4a1-02c8-4965-85d4-75ca4cadb3ed]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:15 devstack sudo[95689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016
Nov 05 03:49:15 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:15 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016" returned: 0 in 0.525s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:15 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016
Nov 05 03:49:15 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:16 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f8240afd-beaf-4dd1-be72-1cb56c95d016" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Lock "cinder-quobyte-f8240afd-beaf-4dd1-be72-1cb56c95d016" released by "delete_volume" :: held 1.128s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Created reservations ['bf626744-32cd-4398-a5d4-815feb9d96a6', '38e91cba-75ee-4eed-8532-966bc8e82cae', 'd1f555fd-0013-4a96-8c41-b65959003e88', '9104dc70-711d-43fa-875e-dc808a5ec60a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:16 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:16 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:16 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.274s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Deleted volume successfully.
Nov 05 03:49:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e48f372b-ee3e-4f6f-ac37-df63978805c1 tempest-VolumeQuotasAdminTestJSON-945715064 None] Lock "cinder-f8240afd-beaf-4dd1-be72-1cb56c95d016-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Flow 'volume_create_manager' (0b22e855-0b5d-4d13-9ece-ccc2c3365c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6201b3-1fe5-45d1-b672-bd5f593b3a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6201b3-1fe5-45d1-b672-bd5f593b3a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1854553638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9498bd40-2121-4c58-b155-13eb105233c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2897467c4b1c40e796d571f89ccbf864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:23Z,use_quota=True,user_id='55faba7a52c44b1691989b49b566e0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd6fd5e-c9a6-475d-849f-859944618806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd6fd5e-c9a6-475d-849f-859944618806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e008a366-e7de-4cd4-a807-df989ba2d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e008a366-e7de-4cd4-a807-df989ba2d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9498bd40-2121-4c58-b155-13eb105233c4', 'volume_name': 'volume-9498bd40-2121-4c58-b155-13eb105233c4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589cf32f-31e7-4806-b3f5-b213c4ac016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589cf32f-31e7-4806-b3f5-b213c4ac016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796eccc-4cab-4f15-af38-fd9115da73cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Volume 9498bd40-2121-4c58-b155-13eb105233c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9498bd40-2121-4c58-b155-13eb105233c4', 'volume_size': 1}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1854553638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9498bd40-2121-4c58-b155-13eb105233c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2897467c4b1c40e796d571f89ccbf864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:23Z,use_quota=True,user_id='55faba7a52c44b1691989b49b566e0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Creating volume 9498bd40-2121-4c58-b155-13eb105233c4 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:49:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:22 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4 1073741824
Nov 05 03:49:22 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:23 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4 1073741824" returned: 0 in 0.770s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:23 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4
Nov 05 03:49:23 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:23 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796eccc-4cab-4f15-af38-fd9115da73cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9498bd40-2121-4c58-b155-13eb105233c4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3042e751-accc-4e09-bdd0-62f65495ecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Volume volume-9498bd40-2121-4c58-b155-13eb105233c4 (9498bd40-2121-4c58-b155-13eb105233c4): created successfully
Nov 05 03:49:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3042e751-accc-4e09-bdd0-62f65495ecc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Flow 'volume_create_manager' (0b22e855-0b5d-4d13-9ece-ccc2c3365c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-5c859798-f5d4-47a4-93f2-acc845639a66 req-0946d916-97ca-45fa-95fe-cdf16000604e tempest-VolumesGetTestJSON-1410215901 None] Created volume successfully.
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Acquiring lock "cinder-9498bd40-2121-4c58-b155-13eb105233c4-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Lock "cinder-9498bd40-2121-4c58-b155-13eb105233c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Acquiring lock "cinder-quobyte-9498bd40-2121-4c58-b155-13eb105233c4" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Lock "cinder-quobyte-9498bd40-2121-4c58-b155-13eb105233c4" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb4b6dc-5c15-4ae6-8424-fd59c0847338]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:25 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4
Nov 05 03:49:25 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:25 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4" returned: 0 in 0.401s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:25 devstack sudo[95720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4
Nov 05 03:49:25 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:26 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9498bd40-2121-4c58-b155-13eb105233c4" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Lock "cinder-quobyte-9498bd40-2121-4c58-b155-13eb105233c4" released by "delete_volume" :: held 0.768s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG cinder.quota [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Created reservations ['b691e548-20d1-4800-bcdb-4d60c5820af8', 'e43cbee1-f4cd-4073-88e9-944b9165b4e3', '77943676-822b-461a-84c6-d87343ccecfe', '66980254-f747-4124-add6-29e0d1aaf5bc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:26 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:26 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:26 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG cinder.manager [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Deleted volume successfully.
Nov 05 03:49:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-2328cccc-699f-41d3-94cf-f7c93f9ac6a5 req-2c79fd35-8b39-4040-a3f8-2e1060f5c4a8 tempest-VolumesGetTestJSON-1410215901 None] Lock "cinder-9498bd40-2121-4c58-b155-13eb105233c4-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Flow 'volume_create_manager' (ad61e871-55ee-472c-ac00-1634608d26c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2964167b-33ba-46bf-9c17-ecbdee28785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2964167b-33ba-46bf-9c17-ecbdee28785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1807367451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b21ca96-28f4-4276-9d30-719877c5cfc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7394e790824ddcbb85943e011949c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:28Z,use_quota=True,user_id='79a8128df1724d1487eaa3a0a6175aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5584185-2881-4a6f-be5c-1431ab8d83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5584185-2881-4a6f-be5c-1431ab8d83ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa6fa27-fe2d-4351-bcde-f2127b11568c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa6fa27-fe2d-4351-bcde-f2127b11568c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b21ca96-28f4-4276-9d30-719877c5cfc2', 'volume_name': 'volume-3b21ca96-28f4-4276-9d30-719877c5cfc2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10f3b6b-fd16-487a-b78b-e289a19bc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10f3b6b-fd16-487a-b78b-e289a19bc554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e82816-d86e-414d-a6b2-f4634e4cf918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:28 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Volume 3b21ca96-28f4-4276-9d30-719877c5cfc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b21ca96-28f4-4276-9d30-719877c5cfc2', 'volume_size': 1}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1807367451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b21ca96-28f4-4276-9d30-719877c5cfc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7394e790824ddcbb85943e011949c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:28Z,use_quota=True,user_id='79a8128df1724d1487eaa3a0a6175aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Creating volume 3b21ca96-28f4-4276-9d30-719877c5cfc2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:28 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:49:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:28 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2 1073741824
Nov 05 03:49:28 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:29 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2 1073741824" returned: 0 in 0.559s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=116,cinder:INSERT=32,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=111,cinder:UPDATE=123,cinder:INSERT=28,cinder:DELETE=11 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:29 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2
Nov 05 03:49:29 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:29 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e82816-d86e-414d-a6b2-f4634e4cf918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b21ca96-28f4-4276-9d30-719877c5cfc2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2407c533-dbfe-44bc-9a73-118cc4469edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:29 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Volume volume-3b21ca96-28f4-4276-9d30-719877c5cfc2 (3b21ca96-28f4-4276-9d30-719877c5cfc2): created successfully
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2407c533-dbfe-44bc-9a73-118cc4469edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Flow 'volume_create_manager' (ad61e871-55ee-472c-ac00-1634608d26c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b09a6a24-8499-4775-a04b-6a72788418a3 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Created volume successfully.
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Acquiring lock "cinder-3b21ca96-28f4-4276-9d30-719877c5cfc2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "cinder-3b21ca96-28f4-4276-9d30-719877c5cfc2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Acquiring lock "cinder-quobyte-3b21ca96-28f4-4276-9d30-719877c5cfc2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "cinder-quobyte-3b21ca96-28f4-4276-9d30-719877c5cfc2" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcae8ba-fcf5-4a1a-a61d-d7893efb9252]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-85dce7f8-acad-4271-a380-2147044e782e tempest-GroupSnapshotsV319Test-1472966850 None] Group tempest-GroupSnapshotsV319Test-Group-367508734: creating
Nov 05 03:49:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-85dce7f8-acad-4271-a380-2147044e782e tempest-GroupSnapshotsV319Test-1472966850 None] Group tempest-GroupSnapshotsV319Test-Group-367508734: created successfully
Nov 05 03:49:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-85dce7f8-acad-4271-a380-2147044e782e tempest-GroupSnapshotsV319Test-1472966850 None] Create group completed successfully.
Nov 05 03:49:32 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2
Nov 05 03:49:32 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:32 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:32 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2
Nov 05 03:49:32 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:33 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3b21ca96-28f4-4276-9d30-719877c5cfc2" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "cinder-quobyte-3b21ca96-28f4-4276-9d30-719877c5cfc2" released by "delete_volume" :: held 0.801s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Created reservations ['df8cf833-22f0-4d55-8394-09bcc5ff2269', '345719c5-9103-4011-9a6b-d927579c4815', '9a85995a-351d-4839-ac1b-60a2040b5610', '65699487-5373-4b60-bdc3-843bc28b7b30'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:33 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:33 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:33 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.369s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Deleted volume successfully.
Nov 05 03:49:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76a0c23f-a9e1-471c-9be1-22185c978969 tempest-VolumeQuotasNegativeTestJSON-1560931768 None] Lock "cinder-3b21ca96-28f4-4276-9d30-719877c5cfc2-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:34 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Flow 'volume_create_manager' (0164ed5b-c5fa-4c9d-8887-a04dcc217453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bf7f1b-87c6-4eef-90fa-169f62bf1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bf7f1b-87c6-4eef-90fa-169f62bf1f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1534848881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce667e44-05bb-4608-b371-4da0f56997ed,host='devstack@QuobyteHD#QuobyteHD',id=b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd0adb9b10c4255bf62233a8d8659fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:35Z,use_quota=True,user_id='3ca299f752a941ae8191d0bfd076743f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd6674ec-5c58-45a3-a040-4c3e54684b60),volume_type_id=dd6674ec-5c58-45a3-a040-4c3e54684b60)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52ae5ee-b4e4-461d-b9e4-0642f3156f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52ae5ee-b4e4-461d-b9e4-0642f3156f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bea933a-fd14-4b6a-b43d-c25373832a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bea933a-fd14-4b6a-b43d-c25373832a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831', 'volume_name': 'volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87aa587-1819-4cec-a2fc-55a0edaca2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87aa587-1819-4cec-a2fc-55a0edaca2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4960706-8c5a-4b4b-903b-1418a09eaf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Volume b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831', 'volume_size': 1}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce667e44-05bb-4608-b371-4da0f56997ed,created_at=2026-11-05T02:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1534848881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce667e44-05bb-4608-b371-4da0f56997ed,host='devstack@QuobyteHD#QuobyteHD',id=b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd0adb9b10c4255bf62233a8d8659fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:35Z,use_quota=True,user_id='3ca299f752a941ae8191d0bfd076743f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd6674ec-5c58-45a3-a040-4c3e54684b60),volume_type_id=dd6674ec-5c58-45a3-a040-4c3e54684b60)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Creating volume b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:35 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:49:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:35 devstack sudo[95782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 1073741824
Nov 05 03:49:35 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:36 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 1073741824" returned: 0 in 0.750s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:36 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831
Nov 05 03:49:36 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:36 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4960706-8c5a-4b4b-903b-1418a09eaf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d2cb2a-6b80-49d4-a5d5-0a2257841a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Volume volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 (b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831): created successfully
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d2cb2a-6b80-49d4-a5d5-0a2257841a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Flow 'volume_create_manager' (0164ed5b-c5fa-4c9d-8887-a04dcc217453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-14ca37e4-95ea-4ff8-9e06-f2df80aa8a08 tempest-GroupSnapshotsV319Test-1472966850 None] Created volume successfully.
Nov 05 03:49:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] GroupSnapshot 1028c47a-be52-4fa5-bdda-a7f727fc4d14: creating.
Nov 05 03:49:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Group snapshot 1028c47a-be52-4fa5-bdda-a7f727fc4d14: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4198}}
Nov 05 03:49:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Creating offline snapshot 654b4706-b6af-403c-98ce-076cb117aae1 of volume b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:49:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a31d07-cf51-49b7-9892-bbf5a191b317]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:37 devstack sudo[95825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831
Nov 05 03:49:37 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:38 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" returned: 0 in 0.562s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:38 devstack sudo[95833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 1G
Nov 05 03:49:38 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:38 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 1G" returned: 0 in 0.556s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:38 devstack sudo[95842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1
Nov 05 03:49:38 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:39 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1" returned: 0 in 0.438s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:39 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:49:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:39 devstack sudo[95849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1
Nov 05 03:49:39 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:39 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1" returned: 0 in 0.484s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:39 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.info
Nov 05 03:49:39 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:40 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.info" returned: 0 in 0.438s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:40 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:49:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:40 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.info
Nov 05 03:49:40 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:40 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.info" returned: 0 in 0.465s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.095s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e30dba0d-3452-4513-bb2d-4b2e43930ab6 tempest-GroupSnapshotsV319Test-1472966850 None] group_snapshot 1028c47a-be52-4fa5-bdda-a7f727fc4d14: created successfully
Nov 05 03:49:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] group_snapshot 1028c47a-be52-4fa5-bdda-a7f727fc4d14: deleting
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] group_snapshot 1028c47a-be52-4fa5-bdda-a7f727fc4d14: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4373}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Acquiring lock "cinder-quobyte-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "cinder-quobyte-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Acquiring lock "cinder-quobyte-654b4706-b6af-403c-98ce-076cb117aae1" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "cinder-quobyte-654b4706-b6af-403c-98ce-076cb117aae1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Deleting offline snapshot 654b4706-b6af-403c-98ce-076cb117aae1 of volume b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] snapshot_file for this snap is: volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[447fedd8-f258-4e75-a8f2-c24a907898ea]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:42 devstack sudo[95860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1
Nov 05 03:49:42 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:43 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1" returned: 0 in 0.631s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:49:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f27fbf6-6c56-4251-8942-5a0832378e76]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:43 devstack sudo[95865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831
Nov 05 03:49:43 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:44 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" returned: 0 in 0.563s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:44 devstack sudo[95870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1
Nov 05 03:49:44 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:44 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1" returned: 0 in 0.553s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:44 devstack sudo[95875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1
Nov 05 03:49:44 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:44 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831.654b4706-b6af-403c-98ce-076cb117aae1" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "cinder-quobyte-654b4706-b6af-403c-98ce-076cb117aae1" released by "_delete_snapshot" :: held 2.304s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Lock "cinder-quobyte-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" released by "delete_snapshot" :: held 2.335s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:45 devstack cinder-volume[87401]: WARNING cinder.quota [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-449467346 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-449467346, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:49:45 devstack cinder-volume[87401]: WARNING cinder.quota [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-449467346 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-449467346, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] Created reservations ['6b400dd8-3260-46c7-85b6-405df0119810', 'c7a0ccd4-3db7-4876-a5a2-816ef292799e', 'c75e35bb-3c38-4ff8-b4be-69b76496a699', '9c4b0bf9-b183-4c32-bf23-28bc8db731c6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8f7ead3e-b1bb-412b-86ef-ff074b97e8d1 tempest-GroupSnapshotsV319Test-1472966850 None] group_snapshot 1028c47a-be52-4fa5-bdda-a7f727fc4d14: deleted successfully
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Flow 'volume_create_manager' (1f9a3da2-ee7f-4313-8747-682816c800f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc11e7b9-6dbc-4aad-9fe6-0da76f61c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc11e7b9-6dbc-4aad-9fe6-0da76f61c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1839015657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66db93aa-b9e3-482f-99e3-5a345f73880a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daddd6d1590448d7abbbfc4db1a96c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:46Z,use_quota=True,user_id='d4a50b4fccf64df08970f69566ff90d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee176964-8546-4aa9-b138-b3f1c5a002db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee176964-8546-4aa9-b138-b3f1c5a002db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9765ff-f794-4c01-8739-864aa3a127d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:45 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9765ff-f794-4c01-8739-864aa3a127d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66db93aa-b9e3-482f-99e3-5a345f73880a', 'volume_name': 'volume-66db93aa-b9e3-482f-99e3-5a345f73880a', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab58dbd40>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98b6887-2858-482c-888d-068d55287f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98b6887-2858-482c-888d-068d55287f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539904f9-e741-4464-8f61-70732266bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Volume 66db93aa-b9e3-482f-99e3-5a345f73880a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66db93aa-b9e3-482f-99e3-5a345f73880a', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab58dbd40>}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Trying to clone 66db93aa-b9e3-482f-99e3-5a345f73880a from image be17f312-5d93-463e-be81-a5040fe456d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Acquiring lock "cinder-quobyte-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Lock "cinder-quobyte-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" acquired by "delete_volume" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde2ae8d-e0d6-4660-a6ca-40af5b4f5970]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:46 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831
Nov 05 03:49:46 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:49:46 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8d51d9-c423-4118-8c0c-7c21009efec5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:47 devstack sudo[95881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD
Nov 05 03:49:47 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:47 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:47 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831
Nov 05 03:49:47 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:47 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 is fetched for user d4a50b4fccf64df08970f69566ff90d5. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ecb62-5f8b-4084-8fd5-9056ec1f6056]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:47 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" returned: 0 in 0.360s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Lock "cinder-quobyte-b3d6fed2-bf5e-49a6-9e1e-2c5b8a4f1831" released by "delete_volume" :: held 1.008s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Flow 'volume_create_manager' (67a41f57-e16e-45cb-97af-3adfae1ff5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c00ac90-d514-4676-9130-6b3b888a543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:47 devstack sudo[95893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD
Nov 05 03:49:47 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c00ac90-d514-4676-9130-6b3b888a543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1679509494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f1a65c-f6bf-4df8-a9e1-6886831f6dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccd07d0a3b744998adc1b9e0d6eb3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:47Z,use_quota=True,user_id='da7d4af3d5244ec0b1ad234c7fc6cd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2468f319-b595-475b-8449-2ba3ddfdf46f),volume_type_id=2468f319-b595-475b-8449-2ba3ddfdf46f)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf34f938-d181-41a8-aa3a-f3d704806b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf34f938-d181-41a8-aa3a-f3d704806b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4017ecb-d633-422e-a9dd-c6e85aa8cc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4017ecb-d633-422e-a9dd-c6e85aa8cc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f1a65c-f6bf-4df8-a9e1-6886831f6dee', 'volume_name': 'volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878379e0-e6af-497a-a8d9-a1fb4260c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878379e0-e6af-497a-a8d9-a1fb4260c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b58a554-c828-4758-ab10-f1464607cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Volume 18f1a65c-f6bf-4df8-a9e1-6886831f6dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee', 'volume_size': 1}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1679509494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f1a65c-f6bf-4df8-a9e1-6886831f6dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccd07d0a3b744998adc1b9e0d6eb3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:47Z,use_quota=True,user_id='da7d4af3d5244ec0b1ad234c7fc6cd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2468f319-b595-475b-8449-2ba3ddfdf46f),volume_type_id=2468f319-b595-475b-8449-2ba3ddfdf46f)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Creating volume 18f1a65c-f6bf-4df8-a9e1-6886831f6dee {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:47 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee 1073741824
Nov 05 03:49:47 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Created reservations ['9d867cb0-1481-4e4d-9892-903eb1a430b8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:47 devstack cinder-volume[87401]: WARNING cinder.quota [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-449467346 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-449467346, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:49:47 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Created reservations ['efde23b4-0053-4d86-ba4d-2cedf90513ad', 'c691bcac-73a4-4053-b521-8932232e67ee', '859d1465-f1b1-4f63-b3f8-b65416363e46', '5e4a578a-a039-4b3b-8be3-5bb11bea6ab1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:48 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:48 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:48 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee 1073741824" returned: 0 in 0.628s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:48 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d6011949-c9ef-4233-833a-4b2aa7282e3e tempest-GroupSnapshotsV319Test-1472966850 None] Delete group completed successfully.
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:48 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee
Nov 05 03:49:48 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:48 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1839015657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66db93aa-b9e3-482f-99e3-5a345f73880a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daddd6d1590448d7abbbfc4db1a96c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:46Z,use_quota=True,user_id='d4a50b4fccf64df08970f69566ff90d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Creating volume 66db93aa-b9e3-482f-99e3-5a345f73880a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:48 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:48 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a 1073741824
Nov 05 03:49:48 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b58a554-c828-4758-ab10-f1464607cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68209cb-92fe-4e88-941b-9210c5135598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Volume volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee (18f1a65c-f6bf-4df8-a9e1-6886831f6dee): created successfully
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68209cb-92fe-4e88-941b-9210c5135598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Flow 'volume_create_manager' (67a41f57-e16e-45cb-97af-3adfae1ff5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-86be9940-e5c6-4408-ba81-4f6a73ce0329 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Created volume successfully.
Nov 05 03:49:49 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a 1073741824" returned: 0 in 0.688s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:49 devstack sudo[95923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a
Nov 05 03:49:49 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:49 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Attempting download of be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume 66db93aa-b9e3-482f-99e3-5a345f73880a. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7586c0-a190-4cb4-8150-ae74a3657aae]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_h8ju7lrx {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:50 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_h8ju7lrx
Nov 05 03:49:50 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:50 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:50 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:50 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_h8ju7lrx" returned: 0 in 0.700s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_h8ju7lrx {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:50 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:50 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-195b59db-0e67-4b3d-a5fc-0e4b19a60ce1 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Retype volume completed successfully.
Nov 05 03:49:50 devstack sudo[95946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_h8ju7lrx
Nov 05 03:49:50 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:51 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_h8ju7lrx" returned: 1 in 0.431s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_h8ju7lrx' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4aa0ed-efeb-4c40-ae38-de3619494369]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:51 devstack sudo[95951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD
Nov 05 03:49:51 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:51 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] be17f312-5d93-463e-be81-a5040fe456d8 was qcow2, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:51 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a
Nov 05 03:49:51 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Acquiring lock "cinder-18f1a65c-f6bf-4df8-a9e1-6886831f6dee-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "cinder-18f1a65c-f6bf-4df8-a9e1-6886831f6dee-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Acquiring lock "cinder-quobyte-18f1a65c-f6bf-4df8-a9e1-6886831f6dee" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "cinder-quobyte-18f1a65c-f6bf-4df8-a9e1-6886831f6dee" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[96846989-6702-4792-8d58-ad6db9684080]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:52 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee
Nov 05 03:49:52 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:52 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee" returned: 0 in 0.603s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:52 devstack sudo[95970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee
Nov 05 03:49:52 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:53 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-18f1a65c-f6bf-4df8-a9e1-6886831f6dee" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "cinder-quobyte-18f1a65c-f6bf-4df8-a9e1-6886831f6dee" released by "delete_volume" :: held 1.066s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:53 devstack cinder-volume[87401]: WARNING cinder.quota [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:49:53 devstack cinder-volume[87401]: WARNING cinder.quota [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Created reservations ['37162716-bc23-481d-8986-c1278cb35cae', 'e93ac7d8-ab7f-47ab-b985-4108d2305f47', '7ff92789-c04f-4462-80be-43861adbfed7', 'eec1115b-da42-451b-9772-3765c47a8831'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:53 devstack sudo[95973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:49:53 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:54 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.656s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:54 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Deleted volume successfully.
Nov 05 03:49:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-805d6e91-d83a-4682-96fb-e43d43427463 tempest-VolumeRetypeWithoutMigrationTest-691056781 None] Lock "cinder-18f1a65c-f6bf-4df8-a9e1-6886831f6dee-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:54 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a" returned: 0 in 3.203s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:54 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_yhhhe9crdevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:49:54 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Converted 112.00 MB image at 34.93 MB/s
Nov 05 03:49:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:54 devstack sudo[96037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a 1G
Nov 05 03:49:54 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:55 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a 1G" returned: 0 in 0.753s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Downloaded image be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume 66db93aa-b9e3-482f-99e3-5a345f73880a successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 for user d4a50b4fccf64df08970f69566ff90d5 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Marking volume 66db93aa-b9e3-482f-99e3-5a345f73880a as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Copying metadata from image be17f312-5d93-463e-be81-a5040fe456d8 to 66db93aa-b9e3-482f-99e3-5a345f73880a. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Creating volume glance metadata for volume 66db93aa-b9e3-482f-99e3-5a345f73880a backed by image be17f312-5d93-463e-be81-a5040fe456d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539904f9-e741-4464-8f61-70732266bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66db93aa-b9e3-482f-99e3-5a345f73880a', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab58dbd40>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09dcba5-ff8c-4a91-8218-507984363994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Volume volume-66db93aa-b9e3-482f-99e3-5a345f73880a (66db93aa-b9e3-482f-99e3-5a345f73880a): created successfully
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09dcba5-ff8c-4a91-8218-507984363994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Flow 'volume_create_manager' (1f9a3da2-ee7f-4313-8747-682816c800f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8f912c85-0ee6-4ff2-97f4-a8328bb8967d tempest-TestShelveInstance-504979996 None] Created volume successfully.
Nov 05 03:50:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d6d94044-8078-4481-821a-12b7b9f3e617 tempest-GroupsTest-764132873 None] Group tempest-Group1-2037005790: creating
Nov 05 03:50:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d6d94044-8078-4481-821a-12b7b9f3e617 tempest-GroupsTest-764132873 None] Group tempest-Group1-2037005790: created successfully
Nov 05 03:50:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d6d94044-8078-4481-821a-12b7b9f3e617 tempest-GroupsTest-764132873 None] Create group completed successfully.
Nov 05 03:50:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9bf56d20-1589-4ea3-aff1-64447c984caa tempest-GroupsTest-764132873 None] Group tempest-Group2-1204563313: creating
Nov 05 03:50:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9bf56d20-1589-4ea3-aff1-64447c984caa tempest-GroupsTest-764132873 None] Group tempest-Group2-1204563313: created successfully
Nov 05 03:50:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9bf56d20-1589-4ea3-aff1-64447c984caa tempest-GroupsTest-764132873 None] Create group completed successfully.
Nov 05 03:50:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-2789e519-9726-4e16-91ab-f948121a810f req-de68466e-061c-4ff8-9d40-17c7846181d8 tempest-TestShelveInstance-504979996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-2789e519-9726-4e16-91ab-f948121a810f req-de68466e-061c-4ff8-9d40-17c7846181d8 tempest-TestShelveInstance-504979996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-2789e519-9726-4e16-91ab-f948121a810f req-de68466e-061c-4ff8-9d40-17c7846181d8 tempest-TestShelveInstance-504979996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-2789e519-9726-4e16-91ab-f948121a810f req-de68466e-061c-4ff8-9d40-17c7846181d8 tempest-TestShelveInstance-504979996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-66db93aa-b9e3-482f-99e3-5a345f73880a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48e561bc-5948-464f-8653-c351e9f809da', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:50:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-2789e519-9726-4e16-91ab-f948121a810f req-de68466e-061c-4ff8-9d40-17c7846181d8 tempest-TestShelveInstance-504979996 None] attachment_update completed successfully.
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Flow 'volume_create_manager' (cbd3ceaa-2f46-4a4f-ac48-f2cc0e16eeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56136301-8ecf-49ea-bd2b-dcf6aa7adc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56136301-8ecf-49ea-bd2b-dcf6aa7adc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672983620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=260f76c7-087a-46f7-abdc-0032e1104eec,host='devstack@QuobyteHD#QuobyteHD',id=d60e60e6-464f-4317-941c-9e29097c2463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80fe422d74940aabe9e469b0751cd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:04Z,use_quota=True,user_id='3ab4aad07b524df4ad0a03273e489831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a9503e-cff2-4678-8a4c-e9c9627fd351),volume_type_id=a7a9503e-cff2-4678-8a4c-e9c9627fd351)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7d1362-7157-4b18-a8d4-0b8a46dc45ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7d1362-7157-4b18-a8d4-0b8a46dc45ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8062faa-69a6-4299-aafc-f3ab0d5d6af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8062faa-69a6-4299-aafc-f3ab0d5d6af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60e60e6-464f-4317-941c-9e29097c2463', 'volume_name': 'volume-d60e60e6-464f-4317-941c-9e29097c2463', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1322a8-e19b-44e1-b915-41c7aad82d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1322a8-e19b-44e1-b915-41c7aad82d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4f5faf-6026-4fe2-9d29-7ab005f52a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Volume d60e60e6-464f-4317-941c-9e29097c2463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60e60e6-464f-4317-941c-9e29097c2463', 'volume_size': 1}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=260f76c7-087a-46f7-abdc-0032e1104eec,created_at=2026-11-05T02:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672983620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=260f76c7-087a-46f7-abdc-0032e1104eec,host='devstack@QuobyteHD#QuobyteHD',id=d60e60e6-464f-4317-941c-9e29097c2463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80fe422d74940aabe9e469b0751cd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:04Z,use_quota=True,user_id='3ab4aad07b524df4ad0a03273e489831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a9503e-cff2-4678-8a4c-e9c9627fd351),volume_type_id=a7a9503e-cff2-4678-8a4c-e9c9627fd351)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Creating volume d60e60e6-464f-4317-941c-9e29097c2463 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:04 devstack sudo[96069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463 1073741824
Nov 05 03:50:04 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:04 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463 1073741824" returned: 0 in 0.723s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:04 devstack sudo[96074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463
Nov 05 03:50:04 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:05 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463" returned: 0 in 0.372s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4f5faf-6026-4fe2-9d29-7ab005f52a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60e60e6-464f-4317-941c-9e29097c2463', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fb269c-bac8-4d31-b3dd-f5e30b8f721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Volume volume-d60e60e6-464f-4317-941c-9e29097c2463 (d60e60e6-464f-4317-941c-9e29097c2463): created successfully
Nov 05 03:50:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fb269c-bac8-4d31-b3dd-f5e30b8f721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Flow 'volume_create_manager' (cbd3ceaa-2f46-4a4f-ac48-f2cc0e16eeb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7ea64278-3c26-45b1-8902-88b510870045 tempest-GroupsTest-764132873 None] Created volume successfully.
Nov 05 03:50:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Acquiring lock "cinder-quobyte-d60e60e6-464f-4317-941c-9e29097c2463" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Lock "cinder-quobyte-d60e60e6-464f-4317-941c-9e29097c2463" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdb42bb-355d-41f7-ad5f-4f149e6bf684]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:08 devstack sudo[96580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463
Nov 05 03:50:08 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:09 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463" returned: 0 in 0.595s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:09 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463
Nov 05 03:50:09 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:09 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d60e60e6-464f-4317-941c-9e29097c2463" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Lock "cinder-quobyte-d60e60e6-464f-4317-941c-9e29097c2463" released by "delete_volume" :: held 1.012s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Created reservations ['8958526f-adc4-4867-8fe5-9886a010efaf'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:09 devstack cinder-volume[87401]: WARNING cinder.quota [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-845962847 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-845962847, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:09 devstack cinder-volume[87401]: WARNING cinder.quota [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-845962847 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-845962847, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Created reservations ['7dd5f7d9-897b-4aa7-b342-9b9780349367', '54fdbcd1-e3c8-426e-ae9b-be4f04d0e6bc', 'eca14ec6-b464-48be-a8f6-56763c339578', '8ab7282c-c702-4c74-a790-7b51390946ad'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:09 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:09 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:10 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-26e805ab-9b6e-41b5-99ef-f6cc8503e48c tempest-GroupsTest-764132873 None] Delete group completed successfully.
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:10 devstack sudo[96594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:10 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:11 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Created reservations ['5566864b-2f2e-4e87-b7eb-d142c383fcaa'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:11 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:11 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:11 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.412s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8398b88a-4c74-4ace-9e38-510fd112157a tempest-GroupsTest-764132873 None] Delete group completed successfully.
Nov 05 03:50:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-28cee6cb-6c53-421f-9426-ceb2d9129319 tempest-GroupsTest-764132873 None] Group tempest-GroupsTest-Group-591143126: creating
Nov 05 03:50:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-28cee6cb-6c53-421f-9426-ceb2d9129319 tempest-GroupsTest-764132873 None] Group tempest-GroupsTest-Group-591143126: created successfully
Nov 05 03:50:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-28cee6cb-6c53-421f-9426-ceb2d9129319 tempest-GroupsTest-764132873 None] Create group completed successfully.
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Flow 'volume_create_manager' (a7ab2576-b16f-4d94-bfc2-4518fba0a887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4231597-8d22-4fbf-8f74-9bbbdecc33e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4231597-8d22-4fbf-8f74-9bbbdecc33e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283644156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5eff6eb6-79f7-44f2-b759-03693e39e0ca,host='devstack@QuobyteHD#QuobyteHD',id=65e12152-ae76-4bf4-8e49-a5567588e275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80fe422d74940aabe9e469b0751cd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:15Z,use_quota=True,user_id='3ab4aad07b524df4ad0a03273e489831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e38cd3b7-6605-4a3f-b5d8-21956dfe872d),volume_type_id=e38cd3b7-6605-4a3f-b5d8-21956dfe872d)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c215f3b-4a82-46ac-90e1-29bc266692f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c215f3b-4a82-46ac-90e1-29bc266692f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f6f156-beab-4ef5-ba71-35d22b52bc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f6f156-beab-4ef5-ba71-35d22b52bc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e12152-ae76-4bf4-8e49-a5567588e275', 'volume_name': 'volume-65e12152-ae76-4bf4-8e49-a5567588e275', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4a667-5318-4ada-82dd-38427db4febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4a667-5318-4ada-82dd-38427db4febe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ecb831-0da6-4c48-88c8-0ad8b489e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Volume 65e12152-ae76-4bf4-8e49-a5567588e275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e12152-ae76-4bf4-8e49-a5567588e275', 'volume_size': 1}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5eff6eb6-79f7-44f2-b759-03693e39e0ca,created_at=2026-11-05T02:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283644156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5eff6eb6-79f7-44f2-b759-03693e39e0ca,host='devstack@QuobyteHD#QuobyteHD',id=65e12152-ae76-4bf4-8e49-a5567588e275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80fe422d74940aabe9e469b0751cd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:15Z,use_quota=True,user_id='3ab4aad07b524df4ad0a03273e489831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e38cd3b7-6605-4a3f-b5d8-21956dfe872d),volume_type_id=e38cd3b7-6605-4a3f-b5d8-21956dfe872d)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Creating volume 65e12152-ae76-4bf4-8e49-a5567588e275 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:15 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:15 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275 1073741824
Nov 05 03:50:15 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Flow 'volume_create_manager' (4d227e65-9410-416d-81fb-86ee429b533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1e8b4d-8ad4-4521-9ae6-837e757bc947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1e8b4d-8ad4-4521-9ae6-837e757bc947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1419173779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e5069f-26c8-4286-a36c-cc0069254aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17457dc7ae1a402e98d319bd1563e0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:16Z,use_quota=True,user_id='a97408770a824fd38e3e659d8a3c856b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3f83c20-8c90-4e4c-94aa-624bdf02337d),volume_type_id=f3f83c20-8c90-4e4c-94aa-624bdf02337d)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5c45f3-2e14-4269-b7f1-b9048e23a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5c45f3-2e14-4269-b7f1-b9048e23a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacb04a4-d1f4-4e04-8c7b-55b37ba726ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacb04a4-d1f4-4e04-8c7b-55b37ba726ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e5069f-26c8-4286-a36c-cc0069254aca', 'volume_name': 'volume-c7e5069f-26c8-4286-a36c-cc0069254aca', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef244ce-0de6-449a-a9d4-08f8d988de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef244ce-0de6-449a-a9d4-08f8d988de4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35691bdf-7cf6-493f-ad84-33fcb2d2198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Volume c7e5069f-26c8-4286-a36c-cc0069254aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e5069f-26c8-4286-a36c-cc0069254aca', 'volume_size': 1}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:15 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275 1073741824" returned: 0 in 0.518s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:15 devstack sudo[96608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275
Nov 05 03:50:15 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:16 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1419173779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e5069f-26c8-4286-a36c-cc0069254aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17457dc7ae1a402e98d319bd1563e0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:16Z,use_quota=True,user_id='a97408770a824fd38e3e659d8a3c856b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3f83c20-8c90-4e4c-94aa-624bdf02337d),volume_type_id=f3f83c20-8c90-4e4c-94aa-624bdf02337d)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Creating volume c7e5069f-26c8-4286-a36c-cc0069254aca {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:16 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ecb831-0da6-4c48-88c8-0ad8b489e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e12152-ae76-4bf4-8e49-a5567588e275', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:16 devstack sudo[96611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca 1073741824
Nov 05 03:50:16 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93ccb75-e7aa-4eb2-95dd-e7f40a5ddc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Volume volume-65e12152-ae76-4bf4-8e49-a5567588e275 (65e12152-ae76-4bf4-8e49-a5567588e275): created successfully
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93ccb75-e7aa-4eb2-95dd-e7f40a5ddc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Flow 'volume_create_manager' (a7ab2576-b16f-4d94-bfc2-4518fba0a887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e1bba4f4-3561-4f7c-80fe-2b6184facb1a tempest-GroupsTest-764132873 None] Created volume successfully.
Nov 05 03:50:16 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca 1073741824" returned: 0 in 0.532s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:16 devstack sudo[96617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca
Nov 05 03:50:16 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:16 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35691bdf-7cf6-493f-ad84-33fcb2d2198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e5069f-26c8-4286-a36c-cc0069254aca', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96211f4-1b5b-4df8-93ad-a5a64ab99d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Volume volume-c7e5069f-26c8-4286-a36c-cc0069254aca (c7e5069f-26c8-4286-a36c-cc0069254aca): created successfully
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96211f4-1b5b-4df8-93ad-a5a64ab99d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Flow 'volume_create_manager' (4d227e65-9410-416d-81fb-86ee429b533e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a8e5010b-baef-4d32-825a-8da65e4ac597 tempest-VolumeTypesAccessTest-708615391 None] Created volume successfully.
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Acquiring lock "cinder-c7e5069f-26c8-4286-a36c-cc0069254aca-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Lock "cinder-c7e5069f-26c8-4286-a36c-cc0069254aca-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Acquiring lock "cinder-quobyte-c7e5069f-26c8-4286-a36c-cc0069254aca" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Lock "cinder-quobyte-c7e5069f-26c8-4286-a36c-cc0069254aca" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7bbc77-9a1c-4e18-8296-0bcdb059b6f7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:18 devstack sudo[96620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca
Nov 05 03:50:18 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Flow 'volume_create_manager' (eccea028-52a3-47ba-989f-6f3ee2798571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c173955-4505-4634-9eac-dbc9fad86619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c173955-4505-4634-9eac-dbc9fad86619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495158276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5eff6eb6-79f7-44f2-b759-03693e39e0ca,host='devstack@QuobyteHD#QuobyteHD',id=703d23c9-0154-4694-a8d9-7d46afe7dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80fe422d74940aabe9e469b0751cd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:18Z,use_quota=True,user_id='3ab4aad07b524df4ad0a03273e489831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e38cd3b7-6605-4a3f-b5d8-21956dfe872d),volume_type_id=e38cd3b7-6605-4a3f-b5d8-21956dfe872d)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff7ab64-654f-4a2b-93de-fa56f39e4561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff7ab64-654f-4a2b-93de-fa56f39e4561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745f43e0-9371-4f3f-a541-b995427ce543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745f43e0-9371-4f3f-a541-b995427ce543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703d23c9-0154-4694-a8d9-7d46afe7dcf8', 'volume_name': 'volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1150ebc5-e8d0-4200-90cf-d107b9800e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1150ebc5-e8d0-4200-90cf-d107b9800e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af771c95-5941-4e67-934d-8003b71d1986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Volume 703d23c9-0154-4694-a8d9-7d46afe7dcf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8', 'volume_size': 1}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5eff6eb6-79f7-44f2-b759-03693e39e0ca,created_at=2026-11-05T02:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495158276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5eff6eb6-79f7-44f2-b759-03693e39e0ca,host='devstack@QuobyteHD#QuobyteHD',id=703d23c9-0154-4694-a8d9-7d46afe7dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80fe422d74940aabe9e469b0751cd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:18Z,use_quota=True,user_id='3ab4aad07b524df4ad0a03273e489831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e38cd3b7-6605-4a3f-b5d8-21956dfe872d),volume_type_id=e38cd3b7-6605-4a3f-b5d8-21956dfe872d)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Creating volume 703d23c9-0154-4694-a8d9-7d46afe7dcf8 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:18 devstack sudo[96625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8 1073741824
Nov 05 03:50:18 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:18 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca" returned: 0 in 0.562s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:18 devstack sudo[96629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca
Nov 05 03:50:18 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:18 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c7e5069f-26c8-4286-a36c-cc0069254aca" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Lock "cinder-quobyte-c7e5069f-26c8-4286-a36c-cc0069254aca" released by "delete_volume" :: held 0.936s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:18 devstack cinder-volume[87401]: WARNING cinder.quota [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1397430356 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1397430356, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:18 devstack cinder-volume[87401]: WARNING cinder.quota [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1397430356 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1397430356, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Created reservations ['394c4d91-c2b4-443b-b9bb-b4191e5b6653', '10eee565-e69d-46a2-bf73-33b431ad24a1', 'a50126a7-10f0-4c28-84f3-72b804587331', '85a52d78-cfc0-4124-89f8-b7a3019eadb6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:19 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8 1073741824" returned: 0 in 0.593s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:19 devstack sudo[96638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:19 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:19 devstack sudo[96640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8
Nov 05 03:50:19 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:19 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Deleted volume successfully.
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3c33b596-e4d1-4f0f-a50b-f02ec0f3f018 tempest-VolumeTypesAccessTest-708615391 None] Lock "cinder-c7e5069f-26c8-4286-a36c-cc0069254aca-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Flow 'volume_create_manager' (3af1d3a2-a89e-4709-8c7e-ff7c118497f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4203081d-4701-46d2-9175-5c91b3214d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4203081d-4701-46d2-9175-5c91b3214d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-404768540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96ca941-dd99-45a7-879c-edb536b762f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6052e12620fd403f98aef6e8c2462410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:19Z,use_quota=True,user_id='59d9c281b6cc4d0d89d408747bbcc163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195d512f-7c33-4c0f-b6b7-90fd12d8b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195d512f-7c33-4c0f-b6b7-90fd12d8b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f09da-f8dd-48a9-90d9-edaf7cff3ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f09da-f8dd-48a9-90d9-edaf7cff3ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96ca941-dd99-45a7-879c-edb536b762f7', 'volume_name': 'volume-e96ca941-dd99-45a7-879c-edb536b762f7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e22bcc-8a23-489c-bcd6-fb97ff20709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e22bcc-8a23-489c-bcd6-fb97ff20709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae85c00-0678-44a4-acd0-5ecb9ea6f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Volume e96ca941-dd99-45a7-879c-edb536b762f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96ca941-dd99-45a7-879c-edb536b762f7', 'volume_size': 1}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8" returned: 0 in 0.502s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-404768540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96ca941-dd99-45a7-879c-edb536b762f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6052e12620fd403f98aef6e8c2462410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:19Z,use_quota=True,user_id='59d9c281b6cc4d0d89d408747bbcc163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Creating volume e96ca941-dd99-45a7-879c-edb536b762f7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:19 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af771c95-5941-4e67-934d-8003b71d1986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e28a24e-baba-40ec-b81a-9577a786bb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7 1073741824
Nov 05 03:50:19 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Volume volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8 (703d23c9-0154-4694-a8d9-7d46afe7dcf8): created successfully
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e28a24e-baba-40ec-b81a-9577a786bb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Flow 'volume_create_manager' (eccea028-52a3-47ba-989f-6f3ee2798571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-90128540-2afd-4b3e-9c14-108610c83d57 tempest-GroupsTest-764132873 None] Created volume successfully.
Nov 05 03:50:20 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7 1073741824" returned: 0 in 0.462s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:20 devstack sudo[96649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7
Nov 05 03:50:20 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:20 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae85c00-0678-44a4-acd0-5ecb9ea6f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96ca941-dd99-45a7-879c-edb536b762f7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8aebf1-eee4-4ef5-96ec-a9f522ce7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Volume volume-e96ca941-dd99-45a7-879c-edb536b762f7 (e96ca941-dd99-45a7-879c-edb536b762f7): created successfully
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8aebf1-eee4-4ef5-96ec-a9f522ce7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Flow 'volume_create_manager' (3af1d3a2-a89e-4709-8c7e-ff7c118497f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-afba30ba-1f21-4d3e-862b-29c66f363f36 tempest-AttachVolumeTestJSON-1222244080 None] Created volume successfully.
Nov 05 03:50:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-517932ca-02ef-4417-9621-30c0bf73c161 tempest-GroupsTest-764132873 None] Update group completed successfully.
Nov 05 03:50:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-88da10f6-f226-4a85-b219-ccfc5a270d3e tempest-GroupsTest-764132873 None] Update group completed successfully.
Nov 05 03:50:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ef968976-cdaa-4e5a-b985-8a05edb8c7c6 req-00bc0078-90d8-4458-9eea-6b3c67f29d44 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ef968976-cdaa-4e5a-b985-8a05edb8c7c6 req-00bc0078-90d8-4458-9eea-6b3c67f29d44 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ef968976-cdaa-4e5a-b985-8a05edb8c7c6 req-00bc0078-90d8-4458-9eea-6b3c67f29d44 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ef968976-cdaa-4e5a-b985-8a05edb8c7c6 req-00bc0078-90d8-4458-9eea-6b3c67f29d44 tempest-AttachVolumeTestJSON-1222244080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-e96ca941-dd99-45a7-879c-edb536b762f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '427a0057-9e92-40e7-b70e-0dd93c364c23', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:50:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ef968976-cdaa-4e5a-b985-8a05edb8c7c6 req-00bc0078-90d8-4458-9eea-6b3c67f29d44 tempest-AttachVolumeTestJSON-1222244080 None] attachment_update completed successfully.
Nov 05 03:50:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Acquiring lock "cinder-quobyte-65e12152-ae76-4bf4-8e49-a5567588e275" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Lock "cinder-quobyte-65e12152-ae76-4bf4-8e49-a5567588e275" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f05315-d030-4f84-aec0-2ecd3115bc54]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:24 devstack sudo[96668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275
Nov 05 03:50:24 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:24 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275" returned: 0 in 0.522s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:24 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275
Nov 05 03:50:24 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:25 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e12152-ae76-4bf4-8e49-a5567588e275" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Lock "cinder-quobyte-65e12152-ae76-4bf4-8e49-a5567588e275" released by "delete_volume" :: held 1.010s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Acquiring lock "cinder-quobyte-703d23c9-0154-4694-a8d9-7d46afe7dcf8" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Lock "cinder-quobyte-703d23c9-0154-4694-a8d9-7d46afe7dcf8" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0c466-3643-4eae-90c0-89cfcb344f63]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:25 devstack sudo[96676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8
Nov 05 03:50:25 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Flow 'volume_create_manager' (ad6dc990-84a5-4f9e-9568-71ca3f062c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363abfe4-7b92-4e3e-b3c1-c375d8456ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363abfe4-7b92-4e3e-b3c1-c375d8456ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-68393858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2121dec6-99f4-4b73-bc20-3d2f43f8be09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6052e12620fd403f98aef6e8c2462410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:26Z,use_quota=True,user_id='59d9c281b6cc4d0d89d408747bbcc163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e91df94-aaa6-4679-835d-6e37e3fa4874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e91df94-aaa6-4679-835d-6e37e3fa4874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749fc04a-2d3f-485a-a83d-72f5d5fce234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749fc04a-2d3f-485a-a83d-72f5d5fce234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2121dec6-99f4-4b73-bc20-3d2f43f8be09', 'volume_name': 'volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a4a8e1-f11d-4e48-99a0-dafcbea0ce91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a4a8e1-f11d-4e48-99a0-dafcbea0ce91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9107b8-bfe6-4092-87f8-b021d553cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Volume 2121dec6-99f4-4b73-bc20-3d2f43f8be09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09', 'volume_size': 1}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-68393858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2121dec6-99f4-4b73-bc20-3d2f43f8be09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6052e12620fd403f98aef6e8c2462410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:26Z,use_quota=True,user_id='59d9c281b6cc4d0d89d408747bbcc163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Creating volume 2121dec6-99f4-4b73-bc20-3d2f43f8be09 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:25 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:25 devstack sudo[96683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09 1073741824
Nov 05 03:50:25 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:25 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8" returned: 0 in 0.549s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:25 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8
Nov 05 03:50:25 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:26 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-703d23c9-0154-4694-a8d9-7d46afe7dcf8" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Lock "cinder-quobyte-703d23c9-0154-4694-a8d9-7d46afe7dcf8" released by "delete_volume" :: held 0.930s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Created reservations ['7c309da7-eb84-41f0-afa1-604cdaca12d6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:26 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09 1073741824" returned: 0 in 0.662s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:26 devstack cinder-volume[87401]: WARNING cinder.quota [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1142516069 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1142516069, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:26 devstack cinder-volume[87401]: WARNING cinder.quota [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1142516069 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1142516069, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Created reservations ['03f9880d-c3e9-44ac-842e-8d568047016f', '1037ddc8-7bca-4948-9fd7-3b7cd56c50c6', '92175d54-5968-451e-afd9-d37c826174f5', '5a08b637-460c-416b-af13-4199dec597fb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:26 devstack sudo[96719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09
Nov 05 03:50:26 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Created reservations ['796cc56e-ece0-461c-8d8f-58998155fdd6', 'b8767879-fd47-4804-81ef-4aa3d44865de', '16de33b3-f144-459c-93c2-bad185144ba0', 'fe89a7d2-7d99-4866-ad28-d61f96692398'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:26 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:26 devstack sudo[96731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:26 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9107b8-bfe6-4092-87f8-b021d553cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab99da4-3c13-47a9-a3f9-96841aafd92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Volume volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09 (2121dec6-99f4-4b73-bc20-3d2f43f8be09): created successfully
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab99da4-3c13-47a9-a3f9-96841aafd92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Flow 'volume_create_manager' (ad6dc990-84a5-4f9e-9568-71ca3f062c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e42c2abd-4d35-4aab-96cb-b08d4d0a3fa7 tempest-AttachVolumeTestJSON-1222244080 None] Created volume successfully.
Nov 05 03:50:27 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f49daa23-de5e-4746-9988-e6f1fe966b36 tempest-GroupsTest-764132873 None] Delete group completed successfully.
Nov 05 03:50:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-a7494c5d-a819-44e0-8407-aedeffc7422b req-c1d5dae9-af14-40bf-90c6-24a935aabdd3 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-a7494c5d-a819-44e0-8407-aedeffc7422b req-c1d5dae9-af14-40bf-90c6-24a935aabdd3 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-a7494c5d-a819-44e0-8407-aedeffc7422b req-c1d5dae9-af14-40bf-90c6-24a935aabdd3 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-a7494c5d-a819-44e0-8407-aedeffc7422b req-c1d5dae9-af14-40bf-90c6-24a935aabdd3 tempest-AttachVolumeTestJSON-1222244080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8a1e20b-13ef-49b4-9817-61bfd0c60f0e', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:50:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-a7494c5d-a819-44e0-8407-aedeffc7422b req-c1d5dae9-af14-40bf-90c6-24a935aabdd3 tempest-AttachVolumeTestJSON-1222244080 None] attachment_update completed successfully.
Nov 05 03:50:30 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=124,cinder:SELECT=128,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:50:30 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=131,cinder:INSERT=35,cinder:UPDATE=116,cinder:DELETE=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:50:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-55c40997-d051-427c-a233-19dfe40b36ac req-03a162f6-0972-4318-bc3d-9b1be25837c4 tempest-AttachVolumeTestJSON-1222244080 None] Terminate volume connection completed successfully.
Nov 05 03:50:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-55c40997-d051-427c-a233-19dfe40b36ac req-03a162f6-0972-4318-bc3d-9b1be25837c4 tempest-AttachVolumeTestJSON-1222244080 None] Deleting attachment 427a0057-9e92-40e7-b70e-0dd93c364c23. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:50:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7f1f73ec-256b-479f-8a89-3db43af50b5d req-b698b3ca-93d2-4fd1-9b60-50a95035ed85 tempest-AttachVolumeTestJSON-1222244080 None] Terminate volume connection completed successfully.
Nov 05 03:50:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7f1f73ec-256b-479f-8a89-3db43af50b5d req-b698b3ca-93d2-4fd1-9b60-50a95035ed85 tempest-AttachVolumeTestJSON-1222244080 None] Deleting attachment e8a1e20b-13ef-49b4-9817-61bfd0c60f0e. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "cinder-2121dec6-99f4-4b73-bc20-3d2f43f8be09-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-2121dec6-99f4-4b73-bc20-3d2f43f8be09-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "cinder-quobyte-2121dec6-99f4-4b73-bc20-3d2f43f8be09" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-quobyte-2121dec6-99f4-4b73-bc20-3d2f43f8be09" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f832c-cdd6-47f2-aa9a-2dcf489c39e5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:39 devstack sudo[96826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09
Nov 05 03:50:39 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:39 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:39 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09
Nov 05 03:50:39 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:40 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2121dec6-99f4-4b73-bc20-3d2f43f8be09" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-quobyte-2121dec6-99f4-4b73-bc20-3d2f43f8be09" released by "delete_volume" :: held 0.785s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Created reservations ['59363a73-0a60-489c-b597-e2f6e192dc27', '0413cd6e-d010-4047-bc8f-b30cb795c044', 'e778b2c2-8875-4d98-bc0c-92a0e43d3440', 'c4daaedb-8c0e-458f-8ec8-560d9089c88b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:40 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:40 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "cinder-e96ca941-dd99-45a7-879c-edb536b762f7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-e96ca941-dd99-45a7-879c-edb536b762f7-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "cinder-quobyte-e96ca941-dd99-45a7-879c-edb536b762f7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-quobyte-e96ca941-dd99-45a7-879c-edb536b762f7" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2960ed-1649-49cd-aca9-1fdc08de51f0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:40 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Deleted volume successfully.
Nov 05 03:50:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-78c2ed55-ca5a-4ca8-8f64-97161379e50b tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-2121dec6-99f4-4b73-bc20-3d2f43f8be09-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:40 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7
Nov 05 03:50:40 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:41 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:41 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7
Nov 05 03:50:41 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:41 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e96ca941-dd99-45a7-879c-edb536b762f7" returned: 0 in 0.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-quobyte-e96ca941-dd99-45a7-879c-edb536b762f7" released by "delete_volume" :: held 0.822s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Created reservations ['12ad2484-8dc0-4433-af6c-b408379b7ba6', 'a467be90-45b8-477e-999e-ef587fc9bb0c', 'd2003b71-c823-4996-8a9f-4a8f2ee8b168', 'e3ee03e1-0ef2-4a9a-811f-e2140a06ac37'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:41 devstack sudo[96846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:41 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "cinder-e3d9a209-7909-4bfc-a384-837b851ac9a2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-e3d9a209-7909-4bfc-a384-837b851ac9a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "cinder-quobyte-e3d9a209-7909-4bfc-a384-837b851ac9a2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:41 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-quobyte-e3d9a209-7909-4bfc-a384-837b851ac9a2" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Deleted volume successfully.
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a110be-ed41-41e0-a64f-9c39b5363f08]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c34cf22-abaf-4bc9-b5a1-f7a97ef6d926 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-e96ca941-dd99-45a7-879c-edb536b762f7-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:42 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2
Nov 05 03:50:42 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:42 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2" returned: 0 in 0.494s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:42 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2
Nov 05 03:50:42 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:42 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3d9a209-7909-4bfc-a384-837b851ac9a2" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-quobyte-e3d9a209-7909-4bfc-a384-837b851ac9a2" released by "delete_volume" :: held 0.868s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Created reservations ['802b85e2-64ea-4c5b-9fb5-949667758bd7', '1b0dbcc6-a2d1-4190-8328-6e923026828c', 'fbc87565-6d95-4fec-9862-eb83d8d7a71c', 'd881efef-7f51-4792-93f8-9a4ac0b4bf2c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:43 devstack sudo[96857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:50:43 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:43 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:43 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Deleted volume successfully.
Nov 05 03:50:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9778e3b9-08b7-4399-99cc-efaa6e769d97 tempest-AttachVolumeTestJSON-1222244080 None] Lock "cinder-e3d9a209-7909-4bfc-a384-837b851ac9a2-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Flow 'volume_create_manager' (13767452-19ed-4dff-bf4e-b854399fa93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6b17e-5277-4f69-bfde-c2ce349ab28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6b17e-5277-4f69-bfde-c2ce349ab28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-916187535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e264de5d-b122-4af7-b96d-fb476417767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204c2910623a48439cf6a2a54dc69fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:45Z,use_quota=True,user_id='16447d9834d040efb4e56c5a31e9e35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c71ccc-0229-4462-a188-7f0dd1fcd331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c71ccc-0229-4462-a188-7f0dd1fcd331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c284e16-0230-4e5f-a5e9-53bf76e3ed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c284e16-0230-4e5f-a5e9-53bf76e3ed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e264de5d-b122-4af7-b96d-fb476417767c', 'volume_name': 'volume-e264de5d-b122-4af7-b96d-fb476417767c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f61b5e0-1fd8-4616-81ef-48d37e715431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f61b5e0-1fd8-4616-81ef-48d37e715431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b297992-e7bc-4777-9bdb-944ea516caf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Volume e264de5d-b122-4af7-b96d-fb476417767c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e264de5d-b122-4af7-b96d-fb476417767c', 'volume_size': 1}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-916187535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e264de5d-b122-4af7-b96d-fb476417767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204c2910623a48439cf6a2a54dc69fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:45Z,use_quota=True,user_id='16447d9834d040efb4e56c5a31e9e35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Creating volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:45 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:45 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c 1073741824
Nov 05 03:50:45 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:46 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c 1073741824" returned: 0 in 0.553s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:46 devstack sudo[96867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c
Nov 05 03:50:46 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:46 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c" returned: 0 in 0.333s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b297992-e7bc-4777-9bdb-944ea516caf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e264de5d-b122-4af7-b96d-fb476417767c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd0cd31-ff2e-4bb2-89d6-033c48178e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Volume volume-e264de5d-b122-4af7-b96d-fb476417767c (e264de5d-b122-4af7-b96d-fb476417767c): created successfully
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd0cd31-ff2e-4bb2-89d6-033c48178e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Flow 'volume_create_manager' (13767452-19ed-4dff-bf4e-b854399fa93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8c802173-4edf-4561-a602-79810bd4c275 tempest-SnapshotsActionsTest-2102143348 None] Created volume successfully.
Nov 05 03:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Creating offline snapshot 01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:50:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[72621fb7-2419-4066-98fd-195fe8bf3591]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:48 devstack sudo[96872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c
Nov 05 03:50:48 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:48 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:48 devstack sudo[96878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 1G
Nov 05 03:50:48 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:49 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 1G" returned: 0 in 0.638s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:49 devstack sudo[96885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:50:49 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:49 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:49 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 is being set with open permissions: ugo+rw
Nov 05 03:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:49 devstack sudo[96890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:50:49 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:49 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.331s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:50 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.info
Nov 05 03:50:50 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:50 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.info" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:50 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.info is being set with open permissions: ugo+rw
Nov 05 03:50:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:50 devstack sudo[96898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.info
Nov 05 03:50:50 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:50 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.info" returned: 0 in 0.372s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8e1fbb18-1e36-4971-b344-11592d377ecb tempest-SnapshotsActionsTest-2102143348 None] Create snapshot completed successfully
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Creating offline snapshot 85e8e219-3463-49e6-a730-ebc0d82a5431 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a61085-310d-4434-a565-b1a7a3d32160]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:52 devstack sudo[96909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:50:52 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:52 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.465s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:50:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:52 devstack sudo[96914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 1G
Nov 05 03:50:52 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:53 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 1G" returned: 0 in 0.748s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:53 devstack sudo[96921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431
Nov 05 03:50:53 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Flow 'volume_create_manager' (c702159d-beed-4172-85cc-06bff0dd39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88ffbfd-c613-4256-ae7b-f46290957fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88ffbfd-c613-4256-ae7b-f46290957fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1079195404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca713ce3-f554-48cd-9551-8bb51b098dfd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81430ec9c88f485ca7a0d5a125ed9698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:54Z,use_quota=True,user_id='92bcc1d19676486fb7dd096bf909486d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2972e52a-7d9e-4c07-af42-a568680e8fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2972e52a-7d9e-4c07-af42-a568680e8fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9255c623-acd3-4797-80ad-b986f1eb8a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9255c623-acd3-4797-80ad-b986f1eb8a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca713ce3-f554-48cd-9551-8bb51b098dfd', 'volume_name': 'volume-ca713ce3-f554-48cd-9551-8bb51b098dfd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4ff3ec-c7a3-4822-b0ab-56b8fbc56d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4ff3ec-c7a3-4822-b0ab-56b8fbc56d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999bc824-fd42-4c48-9750-9104ca771f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Volume ca713ce3-f554-48cd-9551-8bb51b098dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca713ce3-f554-48cd-9551-8bb51b098dfd', 'volume_size': 1}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:54 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431" returned: 0 in 0.687s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:54 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 is being set with open permissions: ugo+rw
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:54 devstack sudo[96944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431
Nov 05 03:50:54 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-78d672ec-ea9f-41e0-a058-3f7e66d38817 req-641faf6f-2240-4bed-8776-3c98abc498fa tempest-TestShelveInstance-504979996 None] Terminate volume connection completed successfully.
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-78d672ec-ea9f-41e0-a058-3f7e66d38817 req-641faf6f-2240-4bed-8776-3c98abc498fa tempest-TestShelveInstance-504979996 None] Deleting attachment 48e561bc-5948-464f-8653-c351e9f809da. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:50:54 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1079195404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca713ce3-f554-48cd-9551-8bb51b098dfd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81430ec9c88f485ca7a0d5a125ed9698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:54Z,use_quota=True,user_id='92bcc1d19676486fb7dd096bf909486d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Creating volume ca713ce3-f554-48cd-9551-8bb51b098dfd {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:54 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:54 devstack sudo[96947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd 1073741824
Nov 05 03:50:54 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-593286ea-5a94-4300-9513-5a7d63af00e2 tempest-SnapshotsActionsTest-2102143348 None] Create snapshot completed successfully
Nov 05 03:50:55 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd 1073741824" returned: 0 in 0.540s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:55 devstack sudo[96952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd
Nov 05 03:50:55 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:55 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999bc824-fd42-4c48-9750-9104ca771f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca713ce3-f554-48cd-9551-8bb51b098dfd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e6b4e-4d2d-408e-91f0-858353bb64d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Volume volume-ca713ce3-f554-48cd-9551-8bb51b098dfd (ca713ce3-f554-48cd-9551-8bb51b098dfd): created successfully
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e6b4e-4d2d-408e-91f0-858353bb64d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Flow 'volume_create_manager' (c702159d-beed-4172-85cc-06bff0dd39dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a0731a54-c298-411c-94a9-7a934bb942d6 tempest-VolumesTestJSON-612076829 None] Created volume successfully.
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-85e8e219-3463-49e6-a730-ebc0d82a5431-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-85e8e219-3463-49e6-a730-ebc0d82a5431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-85e8e219-3463-49e6-a730-ebc0d82a5431" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-85e8e219-3463-49e6-a730-ebc0d82a5431" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Deleting offline snapshot 85e8e219-3463-49e6-a730-ebc0d82a5431 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:50:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] snapshot_file for this snap is: volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:50:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[76da2063-980f-45b0-9458-e1bb92ead640]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:56 devstack sudo[96956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431
Nov 05 03:50:56 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:56 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431" returned: 0 in 0.573s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:50:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e683fb0a-cb9a-48c5-babd-19f3e4d77535]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:56 devstack sudo[96963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:50:56 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Flow 'volume_create_manager' (eecf69d9-9b5b-4525-9bcf-f9cf6897f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb1ff24-9e6b-4902-aaf8-3380fa69cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb1ff24-9e6b-4902-aaf8-3380fa69cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1518417447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d1b34d-d986-40d8-8e45-eca249d48fbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81430ec9c88f485ca7a0d5a125ed9698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:57Z,use_quota=True,user_id='92bcc1d19676486fb7dd096bf909486d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4296cc74-87e8-4d3f-b52a-41a232789c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4296cc74-87e8-4d3f-b52a-41a232789c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7115f1b3-aa4f-45f8-b86b-8ead93324ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7115f1b3-aa4f-45f8-b86b-8ead93324ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d1b34d-d986-40d8-8e45-eca249d48fbe', 'volume_name': 'volume-31d1b34d-d986-40d8-8e45-eca249d48fbe', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab91e08-f1a0-4fb9-9961-942ae93dfb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab91e08-f1a0-4fb9-9961-942ae93dfb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c8076a-dff1-4319-a0d6-3c4c6ea0855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Volume 31d1b34d-d986-40d8-8e45-eca249d48fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d1b34d-d986-40d8-8e45-eca249d48fbe', 'volume_size': 1}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1518417447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d1b34d-d986-40d8-8e45-eca249d48fbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81430ec9c88f485ca7a0d5a125ed9698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:57Z,use_quota=True,user_id='92bcc1d19676486fb7dd096bf909486d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Creating volume 31d1b34d-d986-40d8-8e45-eca249d48fbe {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:57 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe 1073741824
Nov 05 03:50:57 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:57 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.611s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:57 devstack sudo[96970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431
Nov 05 03:50:57 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4002e7b5-ee38-40a0-b90a-756ba84c97da req-01b3528c-5c69-45c2-8d19-9b6d7207e158 tempest-TestShelveInstance-504979996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:57 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431" returned: 0 in 0.523s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:57 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe 1073741824" returned: 0 in 0.625s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:57 devstack sudo[96987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431
Nov 05 03:50:57 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:57 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe
Nov 05 03:50:57 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:58 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.85e8e219-3463-49e6-a730-ebc0d82a5431" returned: 0 in 0.387s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:58 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-85e8e219-3463-49e6-a730-ebc0d82a5431" released by "_delete_snapshot" :: held 2.293s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4002e7b5-ee38-40a0-b90a-756ba84c97da req-01b3528c-5c69-45c2-8d19-9b6d7207e158 tempest-TestShelveInstance-504979996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.646s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" released by "delete_snapshot" :: held 2.335s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c8076a-dff1-4319-a0d6-3c4c6ea0855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d1b34d-d986-40d8-8e45-eca249d48fbe', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8defefee-988d-49d2-ade7-cf255a78a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4002e7b5-ee38-40a0-b90a-756ba84c97da req-01b3528c-5c69-45c2-8d19-9b6d7207e158 tempest-TestShelveInstance-504979996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Volume volume-31d1b34d-d986-40d8-8e45-eca249d48fbe (31d1b34d-d986-40d8-8e45-eca249d48fbe): created successfully
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8defefee-988d-49d2-ade7-cf255a78a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Flow 'volume_create_manager' (eecf69d9-9b5b-4525-9bcf-f9cf6897f18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3e369223-f4bd-4d96-80f3-536e0d5a0988 tempest-VolumesTestJSON-612076829 None] Created volume successfully.
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-4002e7b5-ee38-40a0-b90a-756ba84c97da req-01b3528c-5c69-45c2-8d19-9b6d7207e158 tempest-TestShelveInstance-504979996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-66db93aa-b9e3-482f-99e3-5a345f73880a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85021f30-7964-4d01-ae77-efeccab3d299', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Created reservations ['0ff66fda-7d05-424a-99de-0eba9c757a10', '6a193e80-0011-47d0-be58-084085059e76', 'd6ffbb75-18f6-471a-88d9-5bab3064662c', '78812242-6ef2-487f-abdc-1eb5d56cad5a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-4002e7b5-ee38-40a0-b90a-756ba84c97da req-01b3528c-5c69-45c2-8d19-9b6d7207e158 tempest-TestShelveInstance-504979996 None] attachment_update completed successfully.
Nov 05 03:50:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Delete snapshot completed successfully.
Nov 05 03:50:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f6bd025a-90e9-4dc1-b425-1c3430d6599e tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-85e8e219-3463-49e6-a730-ebc0d82a5431-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Creating offline snapshot 7ea84370-3014-42fe-b75e-4087f9f8c6f7 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:50:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62a65c-be53-4b6f-a3ba-da52ad674659]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:59 devstack sudo[96994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:50:59 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Flow 'volume_create_manager' (7c71f520-e13c-4792-b75a-bd8838db5abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbe49b7-be6c-4295-9443-011a581fe51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbe49b7-be6c-4295-9443-011a581fe51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1376149200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e784e1-264e-47a5-8f76-ab07aef5ea11,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81430ec9c88f485ca7a0d5a125ed9698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:00Z,use_quota=True,user_id='92bcc1d19676486fb7dd096bf909486d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e201ea-e1b0-4bf7-a160-4013f844e706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e201ea-e1b0-4bf7-a160-4013f844e706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a4cd80-c025-407e-840b-8bcf5c09d1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a4cd80-c025-407e-840b-8bcf5c09d1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e784e1-264e-47a5-8f76-ab07aef5ea11', 'volume_name': 'volume-65e784e1-264e-47a5-8f76-ab07aef5ea11', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d453a0-6a1b-49af-b245-79f5efa5b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d453a0-6a1b-49af-b245-79f5efa5b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:00 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08102448-d87b-49c6-9fb6-25811b9df58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Volume 65e784e1-264e-47a5-8f76-ab07aef5ea11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e784e1-264e-47a5-8f76-ab07aef5ea11', 'volume_size': 1}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:00 devstack sudo[96999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 1G
Nov 05 03:51:00 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:00 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 1G" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:00 devstack sudo[97005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7
Nov 05 03:51:00 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:01 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7" returned: 0 in 0.392s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:01 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 is being set with open permissions: ugo+rw
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:01 devstack sudo[97016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7
Nov 05 03:51:01 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:01 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1376149200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e784e1-264e-47a5-8f76-ab07aef5ea11,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81430ec9c88f485ca7a0d5a125ed9698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:00Z,use_quota=True,user_id='92bcc1d19676486fb7dd096bf909486d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Creating volume 65e784e1-264e-47a5-8f76-ab07aef5ea11 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:01 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:01 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11 1073741824
Nov 05 03:51:01 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c874a761-b839-4a99-8225-30df7d656ec2 tempest-SnapshotsActionsTest-2102143348 None] Create snapshot completed successfully
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-7ea84370-3014-42fe-b75e-4087f9f8c6f7-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-7ea84370-3014-42fe-b75e-4087f9f8c6f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-7ea84370-3014-42fe-b75e-4087f9f8c6f7" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-7ea84370-3014-42fe-b75e-4087f9f8c6f7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Deleting offline snapshot 7ea84370-3014-42fe-b75e-4087f9f8c6f7 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] snapshot_file for this snap is: volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2b795-26a2-4bb8-b263-9a0e74dcf126]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:02 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11 1073741824" returned: 0 in 0.687s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:02 devstack sudo[97025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7
Nov 05 03:51:02 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:02 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11
Nov 05 03:51:02 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:02 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:02 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7" returned: 0 in 0.797s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08102448-d87b-49c6-9fb6-25811b9df58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e784e1-264e-47a5-8f76-ab07aef5ea11', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da6107-c064-4e16-a19d-9a53c74fbcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ff4b21-8a68-41ab-9c71-249170b7fceb]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Volume volume-65e784e1-264e-47a5-8f76-ab07aef5ea11 (65e784e1-264e-47a5-8f76-ab07aef5ea11): created successfully
Nov 05 03:51:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da6107-c064-4e16-a19d-9a53c74fbcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Flow 'volume_create_manager' (7c71f520-e13c-4792-b75a-bd8838db5abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4330a8bc-609f-449d-9fe0-4fdb454e9fb8 tempest-VolumesTestJSON-612076829 None] Created volume successfully.
Nov 05 03:51:03 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:03 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:03 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.916s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:03 devstack sudo[97513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7
Nov 05 03:51:03 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:04 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7" returned: 0 in 0.798s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:04 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7
Nov 05 03:51:04 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:05 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.7ea84370-3014-42fe-b75e-4087f9f8c6f7" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Acquiring lock "cinder-65e784e1-264e-47a5-8f76-ab07aef5ea11-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-7ea84370-3014-42fe-b75e-4087f9f8c6f7" released by "_delete_snapshot" :: held 3.234s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Lock "cinder-65e784e1-264e-47a5-8f76-ab07aef5ea11-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" released by "delete_snapshot" :: held 3.272s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Acquiring lock "cinder-quobyte-65e784e1-264e-47a5-8f76-ab07aef5ea11" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Created reservations ['c2ef564c-49a2-4f31-afc9-5b6ef4e00a76', '86e494a1-7505-40f3-b88a-8e882e8d7b0f', 'bbfa2fe0-4622-4ca4-9a1d-15cf081746cc', 'dd8924fb-884d-4edb-8df3-38510c30bb6a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Lock "cinder-quobyte-65e784e1-264e-47a5-8f76-ab07aef5ea11" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af22b42-059b-4a87-a45e-df5891c8cdec]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Delete snapshot completed successfully.
Nov 05 03:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c62359a4-9f31-404d-b2ec-db2be9362f16 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-7ea84370-3014-42fe-b75e-4087f9f8c6f7-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:05 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11
Nov 05 03:51:05 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:06 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11" returned: 0 in 0.518s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:06 devstack sudo[97532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11
Nov 05 03:51:06 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:06 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65e784e1-264e-47a5-8f76-ab07aef5ea11" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Lock "cinder-quobyte-65e784e1-264e-47a5-8f76-ab07aef5ea11" released by "delete_volume" :: held 0.941s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Created reservations ['01e5e970-0516-4294-bd55-9ad6491ab63f', '99e40c2f-b9d6-4a89-8758-a13198b85bf3', '3f231ced-0ac2-4dd0-9975-4917d83378da', '9bf014e5-4103-4bc7-9efd-21d9a1666101'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:06 devstack sudo[97535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:06 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:07 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Deleted volume successfully.
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Creating offline snapshot f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1385fb7-f95c-4703-8e93-18e16b61fe5c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b1fb5097-e93f-41e9-a5d7-3848ab1dfae3 tempest-VolumesTestJSON-612076829 None] Lock "cinder-65e784e1-264e-47a5-8f76-ab07aef5ea11-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:07 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:07 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Acquiring lock "cinder-31d1b34d-d986-40d8-8e45-eca249d48fbe-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Lock "cinder-31d1b34d-d986-40d8-8e45-eca249d48fbe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:07 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.534s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:07 devstack sudo[97543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 1G
Nov 05 03:51:07 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Acquiring lock "cinder-quobyte-31d1b34d-d986-40d8-8e45-eca249d48fbe" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Lock "cinder-quobyte-31d1b34d-d986-40d8-8e45-eca249d48fbe" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[106ff21c-0162-46ed-9e61-764bae221b53]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:07 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe
Nov 05 03:51:07 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:08 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 1G" returned: 0 in 0.667s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:08 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20
Nov 05 03:51:08 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:08 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe" returned: 0 in 0.656s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:08 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe
Nov 05 03:51:08 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:08 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-31d1b34d-d986-40d8-8e45-eca249d48fbe" returned: 0 in 0.466s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:08 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" returned: 0 in 0.589s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:08 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 is being set with open permissions: ugo+rw
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Lock "cinder-quobyte-31d1b34d-d986-40d8-8e45-eca249d48fbe" released by "delete_volume" :: held 1.197s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:08 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20
Nov 05 03:51:08 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Created reservations ['f46d1799-36e6-4d84-a948-1ae1e422210b', 'd7a64b80-b1d8-4a17-9495-25ab0754e797', '1c03b151-8e2d-426a-8daf-9ba1544e6b0b', '512bbcc8-caa0-4e3c-af93-36c4cc1f383d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:09 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:09 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:09 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" returned: 0 in 0.494s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:09 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Deleted volume successfully.
Nov 05 03:51:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-62e7e9a0-b659-4230-90fa-7e8e8ea4cb36 tempest-SnapshotsActionsTest-2102143348 None] Create snapshot completed successfully
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e41a528-c54d-4f12-941d-914f6a585fd7 tempest-VolumesTestJSON-612076829 None] Lock "cinder-31d1b34d-d986-40d8-8e45-eca249d48fbe-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Acquiring lock "cinder-ca713ce3-f554-48cd-9551-8bb51b098dfd-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Lock "cinder-ca713ce3-f554-48cd-9551-8bb51b098dfd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Acquiring lock "cinder-quobyte-ca713ce3-f554-48cd-9551-8bb51b098dfd" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Lock "cinder-quobyte-ca713ce3-f554-48cd-9551-8bb51b098dfd" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[21486e72-75fd-4de7-8168-4e07ee33155b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:10 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd
Nov 05 03:51:10 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Deleting offline snapshot f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] snapshot_file for this snap is: volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa85fc57-f82e-4a14-8041-21c14db1a804]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:10 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd" returned: 0 in 0.532s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:10 devstack sudo[97578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:10 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:10 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd
Nov 05 03:51:10 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:10 devstack sudo[97577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20
Nov 05 03:51:10 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:11 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.589s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:51:11 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca713ce3-f554-48cd-9551-8bb51b098dfd" returned: 0 in 0.655s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Lock "cinder-quobyte-ca713ce3-f554-48cd-9551-8bb51b098dfd" released by "delete_volume" :: held 1.253s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:11 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" returned: 0 in 0.748s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a500d3-0fcc-423a-b933-10e11e22648f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Created reservations ['7fd49355-3ee6-477c-897f-b8e763e31864', 'bad27be9-c332-4823-a83f-72fe59e6df9b', '58fe7723-73ca-4053-9cd7-ebc4ad1a4a97', 'f48ceb4a-784e-4e62-9d88-2a85a2f3beab'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:11 devstack sudo[97588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:11 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:11 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:11 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:11 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.498s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:11 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:11 devstack sudo[97598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20
Nov 05 03:51:11 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Deleted volume successfully.
Nov 05 03:51:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-96a58b74-ed23-4091-853c-a4f132be9b2f tempest-VolumesTestJSON-612076829 None] Lock "cinder-ca713ce3-f554-48cd-9551-8bb51b098dfd-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:12 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:12 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20
Nov 05 03:51:12 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:12 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20" released by "_delete_snapshot" :: held 2.195s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" released by "delete_snapshot" :: held 2.240s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:12 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Created reservations ['813b7dc0-3986-4e0a-8010-aa8693578d84', '4f8ac566-9a3d-4427-9f52-8768bd7553e4', '5c6cafa3-103f-4eb2-8c8e-a554e5abd1f1', 'f5df6c86-b874-42ff-985a-2f4880a360c4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Delete snapshot completed successfully.
Nov 05 03:51:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4d44f778-8005-4010-a7a3-7075fd638c4a tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-f696ab5f-f2eb-4fba-aab5-ff67ae3e8f20-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Creating offline snapshot 88a7b279-ba11-47ce-a495-1a3d2023a115 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:51:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[69854d7a-d21c-4b50-8ccc-bc3d5061030a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:14 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:14 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:14 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.484s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:15 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 1G
Nov 05 03:51:15 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:15 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 1G" returned: 0 in 0.701s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:15 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115
Nov 05 03:51:15 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:16 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115" returned: 0 in 0.398s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:16 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 is being set with open permissions: ugo+rw
Nov 05 03:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:16 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115
Nov 05 03:51:16 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:16 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115" returned: 0 in 0.360s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-01b523f9-2b49-4373-b171-b068c993fdbe tempest-SnapshotsActionsTest-2102143348 None] Create snapshot completed successfully
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-88a7b279-ba11-47ce-a495-1a3d2023a115-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-88a7b279-ba11-47ce-a495-1a3d2023a115-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Acquiring lock "cinder-quobyte-88a7b279-ba11-47ce-a495-1a3d2023a115" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-88a7b279-ba11-47ce-a495-1a3d2023a115" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Deleting offline snapshot 88a7b279-ba11-47ce-a495-1a3d2023a115 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] snapshot_file for this snap is: volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb25ab-15cf-4feb-bcde-44a62d63a217]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:18 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115
Nov 05 03:51:18 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a5c2a4b6-8412-4269-874f-ff2394c4bb34 tempest-BackendsCapabilitiesAdminTestsJSON-1739152949 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4853}}
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-98c096c6-ca90-454f-96c7-97b09460645c tempest-BackendsCapabilitiesAdminTestsJSON-1739152949 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4853}}
Nov 05 03:51:18 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115" returned: 0 in 0.484s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7e05c-1e3e-47c9-b5ff-f5297490c830]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:18 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:18 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:18 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.565s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:19 devstack sudo[97639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115
Nov 05 03:51:19 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:19 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115" returned: 0 in 0.759s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:19 devstack sudo[97647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115
Nov 05 03:51:19 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:20 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.88a7b279-ba11-47ce-a495-1a3d2023a115" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-88a7b279-ba11-47ce-a495-1a3d2023a115" released by "_delete_snapshot" :: held 2.457s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" released by "delete_snapshot" :: held 2.495s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:20 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Created reservations ['09c12ad9-9016-4b43-8d31-951979970b0b', '9b8a00b3-6cf3-4820-bd8a-c56e400ca5a6', '771b5a2a-98d9-4920-a4b6-34d5b5b47d7a', 'e0b18ef7-4026-4603-a541-23388b88bd7c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Delete snapshot completed successfully.
Nov 05 03:51:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-47678f7d-7e3c-44f5-ade2-761b79e20841 tempest-SnapshotsActionsTest-1258040287 None] Lock "cinder-88a7b279-ba11-47ce-a495-1a3d2023a115-delete_snapshot" released by "delete_snapshot" :: held 2.784s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "cinder-01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "cinder-quobyte-01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-quobyte-01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Deleting offline snapshot 01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 of volume e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] snapshot_file for this snap is: volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa5563-3fcb-4288-b27f-9171e9f78c41]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:22 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:22 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:22 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.501s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e264de5d-b122-4af7-b96d-fb476417767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ed1165-331b-4e66-8b1f-bb537cdc7652]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:22 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c
Nov 05 03:51:22 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:23 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c" returned: 0 in 0.451s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:23 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:23 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:23 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.445s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:23 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9
Nov 05 03:51:23 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:23 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c.01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-quobyte-01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9" released by "_delete_snapshot" :: held 1.896s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" released by "delete_snapshot" :: held 1.930s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Created reservations ['2b4a6434-2156-4cae-8d72-d50e24355b57', 'd6a91e18-b351-4dc2-a33b-edad50696824', 'f939dbd0-7d9a-42a2-a349-8eb22fcd9e85', '4121f4a9-4f56-4a07-b408-613f8de7d563'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Delete snapshot completed successfully.
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-94434eca-db41-45b0-bcab-fabfcd6caa0f tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-01e72b6f-a9e3-44eb-9635-ef2f11b8d5c9-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "cinder-e264de5d-b122-4af7-b96d-fb476417767c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-e264de5d-b122-4af7-b96d-fb476417767c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6807de-700a-4e8f-8b23-c64e299e1829]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:24 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c
Nov 05 03:51:24 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:24 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c" returned: 0 in 0.420s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:24 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c
Nov 05 03:51:24 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:25 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e264de5d-b122-4af7-b96d-fb476417767c" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-quobyte-e264de5d-b122-4af7-b96d-fb476417767c" released by "delete_volume" :: held 0.846s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Created reservations ['15be9472-96f7-4bf2-bb14-cd698d244e5e', '313be7dc-d71e-4b78-bad1-9798ae9b77ce', '3339881c-eeda-4b07-9a10-b88f1cd149b2', 'df779d72-646d-4a3b-8b5d-30e5505859a0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:25 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:25 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:25 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Deleted volume successfully.
Nov 05 03:51:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4916ca21-de68-4e3a-95ef-a3c6aaf73c70 tempest-SnapshotsActionsTest-2102143348 None] Lock "cinder-e264de5d-b122-4af7-b96d-fb476417767c-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-68941b96-9e00-4c36-b1ee-ecadc2461178 tempest-GroupSnapshotsTest-1960754983 None] Group tempest-GroupSnapshotsTest-Group-1361132711: creating
Nov 05 03:51:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-68941b96-9e00-4c36-b1ee-ecadc2461178 tempest-GroupSnapshotsTest-1960754983 None] Group tempest-GroupSnapshotsTest-Group-1361132711: created successfully
Nov 05 03:51:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-68941b96-9e00-4c36-b1ee-ecadc2461178 tempest-GroupSnapshotsTest-1960754983 None] Create group completed successfully.
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (6ac0440b-2a1f-4638-9505-d620a62e64c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1461c28e-c545-42ac-98d4-ccab70cf98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1461c28e-c545-42ac-98d4-ccab70cf98f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000020575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5002b85b-16d0-4dfa-8f1b-bb9ceb0afdcd,host='devstack@QuobyteHD#QuobyteHD',id=ee19bc64-60e1-486c-b2de-a7b13b4bceb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:29Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3010c8f4-06f8-47eb-85f8-8fa4438c78b5),volume_type_id=3010c8f4-06f8-47eb-85f8-8fa4438c78b5)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3337c754-9b37-4813-a0d8-e03cfaefbaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3337c754-9b37-4813-a0d8-e03cfaefbaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9964a5e0-de5a-4eb6-91e0-f52c135b8949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9964a5e0-de5a-4eb6-91e0-f52c135b8949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee19bc64-60e1-486c-b2de-a7b13b4bceb2', 'volume_name': 'volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3d346a-81ea-4319-9805-877f27950aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3d346a-81ea-4319-9805-877f27950aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5afb93-8d0e-4e57-bb95-63ebb7f49166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:28 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Volume ee19bc64-60e1-486c-b2de-a7b13b4bceb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2', 'volume_size': 1}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5002b85b-16d0-4dfa-8f1b-bb9ceb0afdcd,created_at=2026-11-05T02:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000020575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5002b85b-16d0-4dfa-8f1b-bb9ceb0afdcd,host='devstack@QuobyteHD#QuobyteHD',id=ee19bc64-60e1-486c-b2de-a7b13b4bceb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:29Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3010c8f4-06f8-47eb-85f8-8fa4438c78b5),volume_type_id=3010c8f4-06f8-47eb-85f8-8fa4438c78b5)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Creating volume ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:28 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:51:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:28 devstack sudo[97719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 1073741824
Nov 05 03:51:28 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:29 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 1073741824" returned: 0 in 0.583s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:29 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2
Nov 05 03:51:29 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:29 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5afb93-8d0e-4e57-bb95-63ebb7f49166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a41074-d638-40c8-8dac-e8fc4b390f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:29 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Volume volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 (ee19bc64-60e1-486c-b2de-a7b13b4bceb2): created successfully
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a41074-d638-40c8-8dac-e8fc4b390f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (6ac0440b-2a1f-4638-9505-d620a62e64c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-81ab18c4-a50a-42fc-ae18-09755db260c6 tempest-GroupSnapshotsTest-1960754983 None] Created volume successfully.
Nov 05 03:51:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] GroupSnapshot 92456400-6fef-48ef-ae1f-8dd472a67f88: creating.
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=99,cinder:UPDATE=100,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=95,cinder:INSERT=23,cinder:UPDATE=114,cinder:DELETE=12 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Group snapshot 92456400-6fef-48ef-ae1f-8dd472a67f88: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4198}}
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Creating offline snapshot 311d3fb8-ad11-44c7-8e70-d1db7f397c96 of volume ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c74172a-2f50-454b-80aa-d32623b9419b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:32 devstack sudo[97743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2
Nov 05 03:51:32 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:32 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:32 devstack sudo[97755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 1G
Nov 05 03:51:32 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:32 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 1G" returned: 0 in 0.496s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:32 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96
Nov 05 03:51:32 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:33 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96" returned: 0 in 0.310s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:33 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:51:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:33 devstack sudo[97766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96
Nov 05 03:51:33 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:33 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:33 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.info
Nov 05 03:51:33 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:33 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.info" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:33 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:51:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:33 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.info
Nov 05 03:51:33 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:34 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.info" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-58db9add-de12-49f2-b733-4648d18013f9 tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 92456400-6fef-48ef-ae1f-8dd472a67f88: created successfully
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-311d3fb8-ad11-44c7-8e70-d1db7f397c96-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-311d3fb8-ad11-44c7-8e70-d1db7f397c96-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Creating volume aa4aca4f-7238-4858-84a9-3bc17cbadd5f from snapshot 311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] snapshot: 311d3fb8-ad11-44c7-8e70-d1db7f397c96, volume: aa4aca4f-7238-4858-84a9-3bc17cbadd5f,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a30f651-f1a1-494a-b8c7-e0f2a726d928]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:37 devstack sudo[97850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96
Nov 05 03:51:37 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:37 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4330a510-4e6c-4b42-9873-1d6e4c711e95]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:37 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2
Nov 05 03:51:37 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:37 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:37 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f
Nov 05 03:51:37 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Flow 'volume_create_manager' (793804ed-6aec-4619-b7a2-d68b2cd2bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d560c5-8760-4abb-b4af-72dd7c56fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d560c5-8760-4abb-b4af-72dd7c56fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-499626905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d60756-cf66-43f0-8741-994c5278c971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00f4b84256c4ebb8a30e55c6779c09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:38Z,use_quota=True,user_id='e26d580f5ce549958e3d6e95c24bc761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744da24d-7208-456b-90a6-9639479d2725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744da24d-7208-456b-90a6-9639479d2725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d738947a-4b1c-43f3-a862-fe1dcecf6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d738947a-4b1c-43f3-a862-fe1dcecf6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d60756-cf66-43f0-8741-994c5278c971', 'volume_name': 'volume-10d60756-cf66-43f0-8741-994c5278c971', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84abf42-4f13-4448-95f4-885054993b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84abf42-4f13-4448-95f4-885054993b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b10811d-e300-4d33-b8ad-efe69b127710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Volume 10d60756-cf66-43f0-8741-994c5278c971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d60756-cf66-43f0-8741-994c5278c971', 'volume_size': 1}
Nov 05 03:51:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (9f5c8631-bc63-4da4-baf6-20187fb9dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b77683b-1801-4c7f-8c31-fe0123ddd034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b77683b-1801-4c7f-8c31-fe0123ddd034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255525938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:40Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ea4019-2244-49c5-a062-d1f44f3f806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ea4019-2244-49c5-a062-d1f44f3f806e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad139dac-b289-45d5-adc5-51c2b9d3acd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad139dac-b289-45d5-adc5-51c2b9d3acd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54', 'volume_name': 'volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4e0d82-a06e-49a5-a232-82fd86d97e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4e0d82-a06e-49a5-a232-82fd86d97e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491c1698-f8f0-4f7b-a169-b842e92a34c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:39 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Volume e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54', 'volume_size': 1}
Nov 05 03:51:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:47 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" returned: 0 in 9.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2, size 1024.00 MB, duration 9.40 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:51:47 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Converted 1024.00 MB image at 108.98 MB/s
Nov 05 03:51:47 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:47 devstack sudo[97938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f
Nov 05 03:51:47 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:47 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" released by "_copy_volume_from_snapshot" :: held 10.925s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-311d3fb8-ad11-44c7-8e70-d1db7f397c96-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" released by "_create_volume_from_snapshot" :: held 11.036s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.065s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.696s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-499626905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d60756-cf66-43f0-8741-994c5278c971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00f4b84256c4ebb8a30e55c6779c09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:38Z,use_quota=True,user_id='e26d580f5ce549958e3d6e95c24bc761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Creating volume 10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:47 devstack sudo[97950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 1073741824
Nov 05 03:51:47 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9e4bc0d7-591b-4f8e-974b-7fed54ff5921 tempest-GroupSnapshotsTest-1960754983 None] Create group from source-snapshot-92456400-6fef-48ef-ae1f-8dd472a67f88 completed successfully.
Nov 05 03:51:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-f7eb5dee-db8b-435c-87d5-c9890f138dc6 tempest-TestShelveInstance-504979996 None] Terminate volume connection completed successfully.
Nov 05 03:51:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-f7eb5dee-db8b-435c-87d5-c9890f138dc6 tempest-TestShelveInstance-504979996 None] Deleting attachment 85021f30-7964-4d01-ae77-efeccab3d299. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:51:48 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 1073741824" returned: 0 in 0.868s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:48 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971
Nov 05 03:51:48 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Acquiring lock "cinder-66db93aa-b9e3-482f-99e3-5a345f73880a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Lock "cinder-66db93aa-b9e3-482f-99e3-5a345f73880a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Acquiring lock "cinder-quobyte-66db93aa-b9e3-482f-99e3-5a345f73880a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Lock "cinder-quobyte-66db93aa-b9e3-482f-99e3-5a345f73880a" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" acquired by "delete_volume" :: waited 0.053s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d48229-29e3-407b-a078-ca24efab4f01]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9639d322-dc5d-49ff-bc68-8d3a02c64805]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:49 devstack sudo[97961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f
Nov 05 03:51:49 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:49 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a
Nov 05 03:51:49 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:49 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971" returned: 0 in 0.629s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.486s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255525938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:40Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Creating volume e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:49 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b10811d-e300-4d33-b8ad-efe69b127710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d60756-cf66-43f0-8741-994c5278c971', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802410a4-5804-4808-99e2-09791497c4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:49 devstack sudo[97966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 1073741824
Nov 05 03:51:49 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Volume volume-10d60756-cf66-43f0-8741-994c5278c971 (10d60756-cf66-43f0-8741-994c5278c971): created successfully
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802410a4-5804-4808-99e2-09791497c4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:49 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Flow 'volume_create_manager' (793804ed-6aec-4619-b7a2-d68b2cd2bab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" returned: 0 in 0.524s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d1c19b0e-c1ce-437e-a02d-7d46694396d6 tempest-SnapshotMetadataTestJSON-119032501 None] Created volume successfully.
Nov 05 03:51:49 devstack sudo[97972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f
Nov 05 03:51:49 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:49 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a" returned: 0 in 0.752s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:49 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a
Nov 05 03:51:49 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:50 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" returned: 0 in 0.472s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-aa4aca4f-7238-4858-84a9-3bc17cbadd5f" released by "delete_volume" :: held 1.078s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:50 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 1073741824" returned: 0 in 0.747s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:50 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-66db93aa-b9e3-482f-99e3-5a345f73880a" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Lock "cinder-quobyte-66db93aa-b9e3-482f-99e3-5a345f73880a" released by "delete_volume" :: held 1.202s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:50 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54
Nov 05 03:51:50 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['35a4ca71-ab6b-4e8b-8206-9b885bc2dd01'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.quota [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Created reservations ['fcdad5f1-da1b-4cd8-a510-c5e53b907b39', '75fc334e-c8a5-492b-81e1-5f227d512570', '5e4a33b6-257c-4b96-ac85-60b8590a3465', 'fd54a189-8558-4a1b-b05b-f917abeb5dd1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:50 devstack cinder-volume[87401]: WARNING cinder.quota [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1955806635 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1955806635, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:51:50 devstack cinder-volume[87401]: WARNING cinder.quota [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1955806635 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1955806635, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['b8a06f0b-c188-4cc5-8a3a-90bef00c5fd2', 'b07a8e96-f0c6-444d-a5f8-4474c69e0051', '5508c081-21e4-4c14-b158-85ec8ac74755', '6251edda-e83a-41a0-bbd7-3eb0589c4661'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:50 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:50 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:50 devstack sudo[98010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:50 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:50 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" returned: 0 in 0.474s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491c1698-f8f0-4f7b-a169-b842e92a34c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a67830-41a8-4f14-84f8-aa2b2eab23c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Volume volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 (e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54): created successfully
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a67830-41a8-4f14-84f8-aa2b2eab23c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (9f5c8631-bc63-4da4-baf6-20187fb9dd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6b610213-58c1-490e-862a-e004158e87cc tempest-VolumesActionsTest-846239010 None] Created volume successfully.
Nov 05 03:51:50 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.manager [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Deleted volume successfully.
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-ddcd63c4-faac-491f-a7b3-74576033c4e7 req-4c0e16ea-873e-468c-af53-45d544c2666a tempest-TestShelveInstance-504979996 None] Lock "cinder-66db93aa-b9e3-482f-99e3-5a345f73880a-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Creating offline snapshot 94169034-3cc3-4e9f-8f29-461afeed809e of volume 10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:51:51 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.358s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e8d2b06c-44fc-440d-ae5f-3e0295716bde tempest-GroupSnapshotsTest-1960754983 None] Delete group completed successfully.
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6fd49f-4cd1-49eb-b847-bb44594dac2d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:51 devstack sudo[98014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971
Nov 05 03:51:51 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:51 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:51 devstack sudo[98020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e 1G
Nov 05 03:51:51 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 92456400-6fef-48ef-ae1f-8dd472a67f88: deleting
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 92456400-6fef-48ef-ae1f-8dd472a67f88: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4373}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-311d3fb8-ad11-44c7-8e70-d1db7f397c96" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-311d3fb8-ad11-44c7-8e70-d1db7f397c96" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Deleting offline snapshot 311d3fb8-ad11-44c7-8e70-d1db7f397c96 of volume ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] snapshot_file for this snap is: volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7afffe0-493a-423d-bf0b-804c28546eb8]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:51 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e 1G" returned: 0 in 0.547s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d60756-cf66-43f0-8741-994c5278c971 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-128d95f0-6ca7-4c8d-810a-e736bab4db2e tempest-VolumesActionsTest-846239010 None] Acquiring lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" by "attach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:51 devstack sudo[98027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d60756-cf66-43f0-8741-994c5278c971 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e
Nov 05 03:51:51 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-128d95f0-6ca7-4c8d-810a-e736bab4db2e tempest-VolumesActionsTest-846239010 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" acquired by "attach_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:52 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96
Nov 05 03:51:52 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-128d95f0-6ca7-4c8d-810a-e736bab4db2e tempest-VolumesActionsTest-846239010 None] Attaching volume e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 to instance b411f644-8b94-4978-926a-03638cbf2fd3 at mountpoint /dev/vdb on host None.
Nov 05 03:51:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-128d95f0-6ca7-4c8d-810a-e736bab4db2e tempest-VolumesActionsTest-846239010 None] Attach volume completed successfully.
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-128d95f0-6ca7-4c8d-810a-e736bab4db2e tempest-VolumesActionsTest-846239010 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" released by "attach_volume" :: held 0.123s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:52 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96" returned: 0 in 0.467s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:52 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d60756-cf66-43f0-8741-994c5278c971 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e" returned: 0 in 0.427s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:52 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e is being set with open permissions: ugo+rw
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae801050-436c-435b-92ed-eb01c162a559]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:52 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e
Nov 05 03:51:52 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:52 devstack sudo[98037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2
Nov 05 03:51:52 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:52 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e" returned: 0 in 0.356s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:52 devstack sudo[98044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.info
Nov 05 03:51:52 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6b4159ad-8e41-4371-aa56-622d61e9c936 tempest-VolumesActionsTest-1077012729 None] Terminate volume connection completed successfully.
Nov 05 03:51:53 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" returned: 0 in 0.660s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:53 devstack sudo[98048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96
Nov 05 03:51:53 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b4159ad-8e41-4371-aa56-622d61e9c936 tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:53 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.info" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:53 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.info is being set with open permissions: ugo+rw
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b4159ad-8e41-4371-aa56-622d61e9c936 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:53 devstack sudo[98050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.info
Nov 05 03:51:53 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6b4159ad-8e41-4371-aa56-622d61e9c936 tempest-VolumesActionsTest-1077012729 None] Detaching volume e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 from instance b411f644-8b94-4978-926a-03638cbf2fd3.
Nov 05 03:51:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6b4159ad-8e41-4371-aa56-622d61e9c936 tempest-VolumesActionsTest-1077012729 None] Detach volume completed successfully.
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b4159ad-8e41-4371-aa56-622d61e9c936 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:53 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.info" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b79e36da-2601-4fe3-8c83-b6b7196cae38 tempest-VolumesActionsTest-846239010 None] Acquiring lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b79e36da-2601-4fe3-8c83-b6b7196cae38 tempest-VolumesActionsTest-846239010 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b79e36da-2601-4fe3-8c83-b6b7196cae38 tempest-VolumesActionsTest-846239010 None] Volume detach called, but volume not attached.
Nov 05 03:51:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f2a658e7-6c4a-4681-8283-2b48488916dc tempest-SnapshotMetadataTestJSON-119032501 None] Create snapshot completed successfully
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b79e36da-2601-4fe3-8c83-b6b7196cae38 tempest-VolumesActionsTest-846239010 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:53 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96" returned: 0 in 0.469s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:53 devstack sudo[98056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96
Nov 05 03:51:53 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Acquiring lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Acquiring lock "cinder-quobyte-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:53 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2.311d3fb8-ad11-44c7-8e70-d1db7f397c96" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-311d3fb8-ad11-44c7-8e70-d1db7f397c96" released by "_delete_snapshot" :: held 2.027s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Lock "cinder-quobyte-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" released by "delete_snapshot" :: held 2.093s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f4f63e-8d18-4bf5-97cf-543fad3814e0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:53 devstack cinder-volume[87401]: WARNING cinder.quota [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1955806635 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1955806635, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['999cd2c6-2b0d-4740-9118-3f51f4266617', '22382142-f8d8-4f0b-9998-e512791b7e7d', '7d58ff9e-c050-455c-97b3-4a92bdc335ba', '17a0c90a-cf20-4f26-b311-61facb9f17cf'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:54 devstack sudo[98059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54
Nov 05 03:51:54 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d8b668ec-9d06-484a-ba28-e964d26d1aaa tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 92456400-6fef-48ef-ae1f-8dd472a67f88: deleted successfully
Nov 05 03:51:54 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:54 devstack sudo[98064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54
Nov 05 03:51:54 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:54 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Lock "cinder-quobyte-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54" released by "delete_volume" :: held 0.836s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Created reservations ['6404e473-51c7-4eca-a38e-ff98ead3a0f2', '837059a7-66ae-4017-b504-8c750ec4b39c', 'dc38fd07-f9be-4b57-a652-2ab5c1736637', '23f3cb2c-c07b-48a1-81c9-a98ae382377e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:54 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:54 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "cinder-94169034-3cc3-4e9f-8f29-461afeed809e-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-94169034-3cc3-4e9f-8f29-461afeed809e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "cinder-quobyte-10d60756-cf66-43f0-8741-994c5278c971" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-quobyte-10d60756-cf66-43f0-8741-994c5278c971" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "cinder-quobyte-94169034-3cc3-4e9f-8f29-461afeed809e" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:55 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-quobyte-94169034-3cc3-4e9f-8f29-461afeed809e" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Deleting offline snapshot 94169034-3cc3-4e9f-8f29-461afeed809e of volume 10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] snapshot_file for this snap is: volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.582s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Deleted volume successfully.
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdecebf-7a53-41ed-be52-a38a1440d8a2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9ad191d6-f70a-441a-a475-83b155bb3622 tempest-VolumesActionsTest-846239010 None] Lock "cinder-e6b9c22d-2a69-4d72-8d1e-7128f7cb0a54-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:55 devstack sudo[98071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e
Nov 05 03:51:55 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ea82da-003f-4f27-981c-11a351f0da79]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2
Nov 05 03:51:56 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e" returned: 0 in 0.764s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d60756-cf66-43f0-8741-994c5278c971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[20908610-6ad2-49ba-9e32-8818ca7a42d1]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" returned: 0 in 0.627s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack sudo[98101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971
Nov 05 03:51:56 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2
Nov 05 03:51:56 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971" returned: 0 in 0.542s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-ee19bc64-60e1-486c-b2de-a7b13b4bceb2" released by "delete_volume" :: held 1.151s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:56 devstack sudo[98111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e
Nov 05 03:51:56 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['ff78f58a-d439-40a7-9086-3dd6737dcd9a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:57 devstack cinder-volume[87401]: WARNING cinder.db.api [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1955806635']
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['6f12f589-cd5f-49a5-98a7-1ea565a50e1d', '40de37db-201c-4d79-b93c-10e99bdc9d86', 'be42bc88-0cea-4a13-8761-10942c9047b3', '7ba92d0f-94bc-4ef3-9da8-e2d6f039f838'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:57 devstack sudo[98117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:57 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:57 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e" returned: 0 in 0.625s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:57 devstack sudo[98120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e
Nov 05 03:51:57 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:57 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d66aa3f5-b00e-4939-b99a-a68126fc868c tempest-GroupSnapshotsTest-1960754983 None] Delete group completed successfully.
Nov 05 03:51:57 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971.94169034-3cc3-4e9f-8f29-461afeed809e" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-quobyte-94169034-3cc3-4e9f-8f29-461afeed809e" released by "_delete_snapshot" :: held 2.522s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-quobyte-10d60756-cf66-43f0-8741-994c5278c971" released by "delete_snapshot" :: held 2.583s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Created reservations ['32ef7b4b-1858-4653-977e-901382ce919d', '9df83dd2-6b6a-410d-9132-91ca18ab0c97', 'f9b3c73d-968f-4ab6-9aa8-a6a61a2b5a5e', 'b0b86bfc-f2ee-43f7-977a-48715c39f514'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Delete snapshot completed successfully.
Nov 05 03:51:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-df629c8e-a44c-4676-985e-57d8f8332c2a tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-94169034-3cc3-4e9f-8f29-461afeed809e-delete_snapshot" released by "delete_snapshot" :: held 2.871s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "cinder-10d60756-cf66-43f0-8741-994c5278c971-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-10d60756-cf66-43f0-8741-994c5278c971-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "cinder-quobyte-10d60756-cf66-43f0-8741-994c5278c971" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-quobyte-10d60756-cf66-43f0-8741-994c5278c971" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[660fcaba-24bb-4d5c-9fde-8ea8eeeea9a6]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-896e8cba-850c-4308-86ee-89b426956823 tempest-GroupSnapshotsTest-1960754983 None] Group tempest-GroupSnapshotsTest-Group-342918335: creating
Nov 05 03:51:58 devstack sudo[98125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971
Nov 05 03:51:58 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-896e8cba-850c-4308-86ee-89b426956823 tempest-GroupSnapshotsTest-1960754983 None] Group tempest-GroupSnapshotsTest-Group-342918335: created successfully
Nov 05 03:51:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-896e8cba-850c-4308-86ee-89b426956823 tempest-GroupSnapshotsTest-1960754983 None] Create group completed successfully.
Nov 05 03:51:59 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971" returned: 0 in 0.502s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:59 devstack sudo[98133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971
Nov 05 03:51:59 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (fe938dd9-870c-493b-9bf3-4ed3e82e4a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087305ce-4b90-40c7-a9d1-2058147f2230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087305ce-4b90-40c7-a9d1-2058147f2230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832651778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24606f0-2879-4a25-8604-028dd5726fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:59Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47359f-da91-439f-976c-171da3d450b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47359f-da91-439f-976c-171da3d450b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d8760d-0619-425f-8fa7-beaac360ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d8760d-0619-425f-8fa7-beaac360ee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24606f0-2879-4a25-8604-028dd5726fb4', 'volume_name': 'volume-a24606f0-2879-4a25-8604-028dd5726fb4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8424fe07-7151-48fb-bb1c-2ae39cf8373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8424fe07-7151-48fb-bb1c-2ae39cf8373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec10c1d-44e7-4548-bbe9-0503c675eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Volume a24606f0-2879-4a25-8604-028dd5726fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24606f0-2879-4a25-8604-028dd5726fb4', 'volume_size': 1}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832651778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24606f0-2879-4a25-8604-028dd5726fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:59Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Creating volume a24606f0-2879-4a25-8604-028dd5726fb4 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:59 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4 1073741824
Nov 05 03:51:59 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:59 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10d60756-cf66-43f0-8741-994c5278c971" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-quobyte-10d60756-cf66-43f0-8741-994c5278c971" released by "delete_volume" :: held 0.908s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Created reservations ['0ff547ea-f474-4c10-b1c6-84e5436a2d17', '71c5fc36-f212-4064-b08c-fcfa45a04f84', '70c01123-0ede-47a4-8725-18136df1ccc5', '197c88ca-cdde-4b97-929d-a08963c2d56b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:59 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:51:59 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:00 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Deleted volume successfully.
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-efe2e236-4de2-4228-a49d-3277dc35ab81 tempest-SnapshotMetadataTestJSON-119032501 None] Lock "cinder-10d60756-cf66-43f0-8741-994c5278c971-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:00 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4 1073741824" returned: 0 in 0.707s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:00 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4
Nov 05 03:52:00 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:00 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec10c1d-44e7-4548-bbe9-0503c675eece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24606f0-2879-4a25-8604-028dd5726fb4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60297c8f-b7a6-4b8a-9fc6-45b7ba5bd2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Volume volume-a24606f0-2879-4a25-8604-028dd5726fb4 (a24606f0-2879-4a25-8604-028dd5726fb4): created successfully
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60297c8f-b7a6-4b8a-9fc6-45b7ba5bd2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (fe938dd9-870c-493b-9bf3-4ed3e82e4a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4ad0bf32-7fa5-40b3-932b-3ebd6890fca7 tempest-VolumesActionsTest-846239010 None] Created volume successfully.
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (37fd63a0-a93d-4435-b80c-2c7885f9ac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fc3974-5083-49c3-9b50-02f3878d79b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fc3974-5083-49c3-9b50-02f3878d79b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153799996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=983f4682-56ec-46c5-9585-fe3c870988d5,host='devstack@QuobyteHD#QuobyteHD',id=b5a1ef52-b955-46a5-84f0-529b76939c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:01Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad1a315e-3fed-45b6-9569-740efb6822d0),volume_type_id=ad1a315e-3fed-45b6-9569-740efb6822d0)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e10cf04-02ba-41b0-9c43-59a920d90dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e10cf04-02ba-41b0-9c43-59a920d90dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a987142f-d958-4513-a067-a270217f5051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a987142f-d958-4513-a067-a270217f5051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a1ef52-b955-46a5-84f0-529b76939c1a', 'volume_name': 'volume-b5a1ef52-b955-46a5-84f0-529b76939c1a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e59d7f-266e-4c2d-9d8a-cf8467dd9d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e59d7f-266e-4c2d-9d8a-cf8467dd9d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83296768-a2a9-488c-bab0-7f2e7a854df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Volume b5a1ef52-b955-46a5-84f0-529b76939c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a1ef52-b955-46a5-84f0-529b76939c1a', 'volume_size': 1}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=983f4682-56ec-46c5-9585-fe3c870988d5,created_at=2026-11-05T02:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153799996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=983f4682-56ec-46c5-9585-fe3c870988d5,host='devstack@QuobyteHD#QuobyteHD',id=b5a1ef52-b955-46a5-84f0-529b76939c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:01Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad1a315e-3fed-45b6-9569-740efb6822d0),volume_type_id=ad1a315e-3fed-45b6-9569-740efb6822d0)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Creating volume b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:01 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a 1073741824
Nov 05 03:52:01 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:01 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a 1073741824" returned: 0 in 0.606s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:01 devstack sudo[98154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a
Nov 05 03:52:01 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-a24606f0-2879-4a25-8604-028dd5726fb4-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Lock "cinder-a24606f0-2879-4a25-8604-028dd5726fb4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-quobyte-a24606f0-2879-4a25-8604-028dd5726fb4" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-a24606f0-2879-4a25-8604-028dd5726fb4" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc0d21-2247-438d-8029-db197ab1e98f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:02 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83296768-a2a9-488c-bab0-7f2e7a854df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a1ef52-b955-46a5-84f0-529b76939c1a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bd4cb2-42e7-40a1-8845-a827ca7dbdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Volume volume-b5a1ef52-b955-46a5-84f0-529b76939c1a (b5a1ef52-b955-46a5-84f0-529b76939c1a): created successfully
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bd4cb2-42e7-40a1-8845-a827ca7dbdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (37fd63a0-a93d-4435-b80c-2c7885f9ac59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:02 devstack sudo[98157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4
Nov 05 03:52:02 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-adf5154b-fc44-4fda-a522-49f068e1209c tempest-GroupSnapshotsTest-1960754983 None] Created volume successfully.
Nov 05 03:52:02 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4" returned: 0 in 0.450s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:02 devstack sudo[98162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4
Nov 05 03:52:02 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:02 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a24606f0-2879-4a25-8604-028dd5726fb4" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-a24606f0-2879-4a25-8604-028dd5726fb4" released by "delete_volume" :: held 0.804s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Created reservations ['1fe5736f-0c70-4079-8711-955290f566c2', 'f55d0fb0-55bf-4e92-8e4e-a05747ea7764', 'e6c6712d-fcc8-4223-88aa-877e97558b0f', '1fae0153-ac59-458c-8d22-413eee791a26'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:02 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:02 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:03 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:03 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Deleted volume successfully.
Nov 05 03:52:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52416ff1-8b00-4643-8ca3-ebd8bbfc795e tempest-VolumesActionsTest-1077012729 None] Lock "cinder-a24606f0-2879-4a25-8604-028dd5726fb4-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (20682bc9-0495-45c6-8e6f-c0b1e9db0b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c245b-8b36-4669-8471-709b0251c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c245b-8b36-4669-8471-709b0251c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255383671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6767dec-b27c-47c0-af50-770bc3756540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:04Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613dd7e5-4c04-4b4d-8fb2-c432ed7a5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613dd7e5-4c04-4b4d-8fb2-c432ed7a5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b188ad06-e3ab-4440-84ab-797471da4f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b188ad06-e3ab-4440-84ab-797471da4f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6767dec-b27c-47c0-af50-770bc3756540', 'volume_name': 'volume-c6767dec-b27c-47c0-af50-770bc3756540', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0351f3-4374-4c44-b842-7eeecba4bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0351f3-4374-4c44-b842-7eeecba4bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaab3a0-2ab3-4916-b1a8-e29b197420fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Volume c6767dec-b27c-47c0-af50-770bc3756540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6767dec-b27c-47c0-af50-770bc3756540', 'volume_size': 1}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255383671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6767dec-b27c-47c0-af50-770bc3756540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:04Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Creating volume c6767dec-b27c-47c0-af50-770bc3756540 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:04 devstack sudo[98170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540 1073741824
Nov 05 03:52:04 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (15dd6ecd-b8d9-46a5-b705-92f4fffd3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb88121-ac26-42b9-bc03-216e1803d111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb88121-ac26-42b9-bc03-216e1803d111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1242474335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=983f4682-56ec-46c5-9585-fe3c870988d5,host='devstack@QuobyteHD#QuobyteHD',id=17ffea0e-ff99-455f-b9f8-3c8ca946782a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:04Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad1a315e-3fed-45b6-9569-740efb6822d0),volume_type_id=ad1a315e-3fed-45b6-9569-740efb6822d0)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2082e11-fb81-4602-bde1-367f312e1b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2082e11-fb81-4602-bde1-367f312e1b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4efee0-843a-4824-bd59-564a86dbe9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4efee0-843a-4824-bd59-564a86dbe9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ffea0e-ff99-455f-b9f8-3c8ca946782a', 'volume_name': 'volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3497f49-1807-4caf-a146-9c4efc6e2416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3497f49-1807-4caf-a146-9c4efc6e2416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbece48-8930-4edf-ba67-3d6b69635060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Volume 17ffea0e-ff99-455f-b9f8-3c8ca946782a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a', 'volume_size': 1}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:04 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540 1073741824" returned: 0 in 0.577s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:04 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540
Nov 05 03:52:04 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:05 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540" returned: 0 in 0.290s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=983f4682-56ec-46c5-9585-fe3c870988d5,created_at=2026-11-05T02:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1242474335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=983f4682-56ec-46c5-9585-fe3c870988d5,host='devstack@QuobyteHD#QuobyteHD',id=17ffea0e-ff99-455f-b9f8-3c8ca946782a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:04Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad1a315e-3fed-45b6-9569-740efb6822d0),volume_type_id=ad1a315e-3fed-45b6-9569-740efb6822d0)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Creating volume 17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaab3a0-2ab3-4916-b1a8-e29b197420fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6767dec-b27c-47c0-af50-770bc3756540', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35698d66-9376-43f2-bb72-2189c958f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:05 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a 1073741824
Nov 05 03:52:05 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Volume volume-c6767dec-b27c-47c0-af50-770bc3756540 (c6767dec-b27c-47c0-af50-770bc3756540): created successfully
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35698d66-9376-43f2-bb72-2189c958f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (20682bc9-0495-45c6-8e6f-c0b1e9db0b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bb5ac02e-77cd-4e1e-bf7c-6d103a7d60b7 tempest-VolumesActionsTest-846239010 None] Created volume successfully.
Nov 05 03:52:05 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a 1073741824" returned: 0 in 0.633s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:05 devstack sudo[98185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a
Nov 05 03:52:05 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:06 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a" returned: 0 in 0.277s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbece48-8930-4edf-ba67-3d6b69635060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f82b377-8336-4154-842b-8ba8146c9155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Volume volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a (17ffea0e-ff99-455f-b9f8-3c8ca946782a): created successfully
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f82b377-8336-4154-842b-8ba8146c9155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (15dd6ecd-b8d9-46a5-b705-92f4fffd3137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ff3e10c8-5fda-4214-8b1f-eade810119b0 tempest-GroupSnapshotsTest-1960754983 None] Created volume successfully.
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-c6767dec-b27c-47c0-af50-770bc3756540-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-c6767dec-b27c-47c0-af50-770bc3756540-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-quobyte-c6767dec-b27c-47c0-af50-770bc3756540" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-c6767dec-b27c-47c0-af50-770bc3756540" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee897f09-a5ce-4908-88c7-c76215200019]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:06 devstack sudo[98188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540
Nov 05 03:52:06 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:06 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Flow 'volume_create_manager' (cc8e4eb7-2550-4d6d-bf6f-18e229390f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede49767-66d2-4599-a6ed-8108cbc049dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540" returned: 0 in 0.538s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:07 devstack sudo[98193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540
Nov 05 03:52:07 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede49767-66d2-4599-a6ed-8108cbc049dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-486714740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca718a24-3ffa-43c2-a208-3c81162d830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b710669e98445c0ae5e39b6021de2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:07Z,use_quota=True,user_id='06f1ec6baca5473a99cf9d967c8ea3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac5e70-018e-4d00-92a9-daf85959a5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac5e70-018e-4d00-92a9-daf85959a5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee834da-39d3-40ca-ab48-64fdde7659c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee834da-39d3-40ca-ab48-64fdde7659c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca718a24-3ffa-43c2-a208-3c81162d830f', 'volume_name': 'volume-ca718a24-3ffa-43c2-a208-3c81162d830f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176413cc-ea61-4ae6-bf6a-02d7a99ce20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176413cc-ea61-4ae6-bf6a-02d7a99ce20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec1c551-101b-4bc7-9f33-58f45746cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Volume ca718a24-3ffa-43c2-a208-3c81162d830f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca718a24-3ffa-43c2-a208-3c81162d830f', 'volume_size': 1}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-486714740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca718a24-3ffa-43c2-a208-3c81162d830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b710669e98445c0ae5e39b6021de2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:07Z,use_quota=True,user_id='06f1ec6baca5473a99cf9d967c8ea3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Creating volume ca718a24-3ffa-43c2-a208-3c81162d830f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:07 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:07 devstack sudo[98195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f 1073741824
Nov 05 03:52:07 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dfa237b0-af63-4526-8377-dbad4600884c tempest-GroupSnapshotsTest-1960754983 None] Update group completed successfully.
Nov 05 03:52:07 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c6767dec-b27c-47c0-af50-770bc3756540" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-c6767dec-b27c-47c0-af50-770bc3756540" released by "delete_volume" :: held 0.896s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Created reservations ['062644af-d28c-49c3-8a2c-bddaed46ab31', '35467741-3dbd-449a-bfbd-f8826e0f3e77', '8d7f7be1-cbd5-40ff-8186-f1a78ddc7d84', 'e74d52cc-d5c7-46c5-a529-17e965f8f9be'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:07 devstack sudo[98202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:07 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:07 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f 1073741824" returned: 0 in 0.577s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:07 devstack sudo[98204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f
Nov 05 03:52:07 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:07 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Deleted volume successfully.
Nov 05 03:52:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ce7684b3-f940-4c5f-83b3-d09ff733e5b5 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-c6767dec-b27c-47c0-af50-770bc3756540-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:08 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec1c551-101b-4bc7-9f33-58f45746cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca718a24-3ffa-43c2-a208-3c81162d830f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab44f074-92a6-418b-8e4d-65dee042975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Volume volume-ca718a24-3ffa-43c2-a208-3c81162d830f (ca718a24-3ffa-43c2-a208-3c81162d830f): created successfully
Nov 05 03:52:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab44f074-92a6-418b-8e4d-65dee042975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Flow 'volume_create_manager' (cc8e4eb7-2550-4d6d-bf6f-18e229390f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f680205f-1282-4464-9cc7-f0a8670b5c39 tempest-AbsoluteLimitsTests-1995455736 None] Created volume successfully.
Nov 05 03:52:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7bfaf6e6-c67c-4bda-bd40-1d9d2ec6b653 tempest-GroupSnapshotsTest-1960754983 None] Update group completed successfully.
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (b178b2fd-be33-4dbb-8cd0-ad6e0a9e05fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37068c7-fa63-4d62-84a0-adc81a26d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37068c7-fa63-4d62-84a0-adc81a26d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131518469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01970f52-0025-4ad3-87af-ea0505a3de2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:09Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa8494b-50d7-45a4-96e5-b14b3afac773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa8494b-50d7-45a4-96e5-b14b3afac773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d09efd-c948-47de-aa37-a3c440e284f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d09efd-c948-47de-aa37-a3c440e284f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01970f52-0025-4ad3-87af-ea0505a3de2f', 'volume_name': 'volume-01970f52-0025-4ad3-87af-ea0505a3de2f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a686f8c-9cad-4e3a-a776-ad1998970fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a686f8c-9cad-4e3a-a776-ad1998970fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a7da11-5013-45d2-8052-931f46952905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Volume 01970f52-0025-4ad3-87af-ea0505a3de2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01970f52-0025-4ad3-87af-ea0505a3de2f', 'volume_size': 1}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131518469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01970f52-0025-4ad3-87af-ea0505a3de2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:09Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Creating volume 01970f52-0025-4ad3-87af-ea0505a3de2f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:09 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:09 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f 1073741824
Nov 05 03:52:09 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b27d85c0-baa0-44bc-981f-15a20bb5c973 tempest-GroupSnapshotsTest-1960754983 None] Update group completed successfully.
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Acquiring lock "cinder-ca718a24-3ffa-43c2-a208-3c81162d830f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Lock "cinder-ca718a24-3ffa-43c2-a208-3c81162d830f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Acquiring lock "cinder-quobyte-ca718a24-3ffa-43c2-a208-3c81162d830f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Lock "cinder-quobyte-ca718a24-3ffa-43c2-a208-3c81162d830f" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83f5aee-955e-4625-a35e-1988be5adff4]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:09 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f
Nov 05 03:52:09 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:09 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f 1073741824" returned: 0 in 0.602s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:10 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f
Nov 05 03:52:10 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:10 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f" returned: 0 in 0.486s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:10 devstack sudo[98222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f
Nov 05 03:52:10 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:10 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a7da11-5013-45d2-8052-931f46952905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01970f52-0025-4ad3-87af-ea0505a3de2f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a263a324-bd87-4f24-aad5-b4d957bd66f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Volume volume-01970f52-0025-4ad3-87af-ea0505a3de2f (01970f52-0025-4ad3-87af-ea0505a3de2f): created successfully
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a263a324-bd87-4f24-aad5-b4d957bd66f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (b178b2fd-be33-4dbb-8cd0-ad6e0a9e05fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bfb3b832-de2b-410a-bffd-08d9eaf0f67c tempest-VolumesActionsTest-846239010 None] Created volume successfully.
Nov 05 03:52:10 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ca718a24-3ffa-43c2-a208-3c81162d830f" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Lock "cinder-quobyte-ca718a24-3ffa-43c2-a208-3c81162d830f" released by "delete_volume" :: held 0.873s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Created reservations ['f7a7cb19-a6d1-4688-bc91-f3b6038e8a66', '1e776f57-9b8a-41d9-98c9-67578dfb913c', 'ac99eb6a-a607-41ea-aaf2-5d6573cac64b', '011c5888-5a5b-4844-8357-96851fed3c99'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:10 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:10 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:10 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:10 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b0a31221-bedc-4442-b8c7-be364689682b tempest-GroupSnapshotsTest-1960754983 None] Update group completed successfully.
Nov 05 03:52:11 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:52:11 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Deleted volume successfully.
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a872030d-fcd2-4616-b613-a7fe8a23eaa3 tempest-AbsoluteLimitsTests-1995455736 None] Lock "cinder-ca718a24-3ffa-43c2-a208-3c81162d830f-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-01970f52-0025-4ad3-87af-ea0505a3de2f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Lock "cinder-01970f52-0025-4ad3-87af-ea0505a3de2f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-quobyte-01970f52-0025-4ad3-87af-ea0505a3de2f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-01970f52-0025-4ad3-87af-ea0505a3de2f" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[32964a24-e7e0-4f2c-8f75-b822ad6f1602]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:11 devstack sudo[98232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f
Nov 05 03:52:11 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:12 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:12 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f
Nov 05 03:52:12 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] GroupSnapshot 589f0b8e-d024-4dca-8311-763dc45c54e6: creating.
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Group snapshot 589f0b8e-d024-4dca-8311-763dc45c54e6: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4198}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Creating offline snapshot 4a6b8bf6-3787-4da1-9bac-c0695c63b699 of volume b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[256037a6-f15c-4397-8b08-a894e2a71e88]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:12 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01970f52-0025-4ad3-87af-ea0505a3de2f" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-01970f52-0025-4ad3-87af-ea0505a3de2f" released by "delete_volume" :: held 0.935s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Created reservations ['c0cdbeeb-c1b7-4e6a-95e7-38a4454b203a', '4cd390dd-6299-4611-98d9-b87eb91fd623', 'a715c70e-2cb5-4ef1-8898-e495f033600d', '2ed8624d-4c89-4102-adee-dfc23bff7967'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:12 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a
Nov 05 03:52:12 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:12 devstack sudo[98242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:12 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:13 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a" returned: 0 in 0.590s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:13 devstack sudo[98248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 1G
Nov 05 03:52:13 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:13 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:13 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Deleted volume successfully.
Nov 05 03:52:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2968d7f1-5fce-4f06-9232-37fb251611ec tempest-VolumesActionsTest-1077012729 None] Lock "cinder-01970f52-0025-4ad3-87af-ea0505a3de2f-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:13 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 1G" returned: 0 in 0.580s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a1ef52-b955-46a5-84f0-529b76939c1a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:13 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a1ef52-b955-46a5-84f0-529b76939c1a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699
Nov 05 03:52:13 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:14 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a1ef52-b955-46a5-84f0-529b76939c1a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:14 devstack sudo[98259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699
Nov 05 03:52:14 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:14 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699" returned: 0 in 0.358s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:14 devstack sudo[98262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.info
Nov 05 03:52:14 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (0d19b66f-e7a2-42f1-b4b7-26dfcda0dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff889635-cbd4-443c-a8df-c3d570a31048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff889635-cbd4-443c-a8df-c3d570a31048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691046382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f741df-93bb-4126-a33c-d72549e53852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:14Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe7dba8-e7e6-40b4-9c89-1389ca3fbbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe7dba8-e7e6-40b4-9c89-1389ca3fbbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b110c2-cc29-4ad3-8f74-d50b7ceb88c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b110c2-cc29-4ad3-8f74-d50b7ceb88c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f741df-93bb-4126-a33c-d72549e53852', 'volume_name': 'volume-e2f741df-93bb-4126-a33c-d72549e53852', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af21e1b0-7483-4a2b-a916-bb6e8cc60a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af21e1b0-7483-4a2b-a916-bb6e8cc60a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd6e3fb-62e3-467c-b554-b6a26f52afc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Volume e2f741df-93bb-4126-a33c-d72549e53852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f741df-93bb-4126-a33c-d72549e53852', 'volume_size': 1}
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:14 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.info" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:14 devstack sudo[98265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.info
Nov 05 03:52:14 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:15 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.info" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Creating offline snapshot ec0df453-0791-4953-87bb-890e90d9b4aa of volume 17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd9dfd-e151-415b-b7b1-c6f01bdb94f9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:15 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a
Nov 05 03:52:15 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:15 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:15 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa 1G
Nov 05 03:52:15 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:16 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa 1G" returned: 0 in 0.552s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:16 devstack sudo[98279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa
Nov 05 03:52:16 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:16 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:16 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:52:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:16 devstack sudo[98285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa
Nov 05 03:52:16 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:16 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:16 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.info
Nov 05 03:52:16 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:17 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.info" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:17 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:17 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.info
Nov 05 03:52:17 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:17 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.info" returned: 0 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.967s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691046382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f741df-93bb-4126-a33c-d72549e53852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:14Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Creating volume e2f741df-93bb-4126-a33c-d72549e53852 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:17 devstack sudo[98294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852 1073741824
Nov 05 03:52:17 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2d53df65-bc5b-484d-9bce-64bcc794f1ae tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 589f0b8e-d024-4dca-8311-763dc45c54e6: created successfully
Nov 05 03:52:18 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852 1073741824" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:18 devstack sudo[98300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852
Nov 05 03:52:18 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:18 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd6e3fb-62e3-467c-b554-b6a26f52afc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f741df-93bb-4126-a33c-d72549e53852', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aaf0ec-31cc-480b-b950-73b9e532546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Volume volume-e2f741df-93bb-4126-a33c-d72549e53852 (e2f741df-93bb-4126-a33c-d72549e53852): created successfully
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aaf0ec-31cc-480b-b950-73b9e532546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (0d19b66f-e7a2-42f1-b4b7-26dfcda0dc85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-997fba17-b041-49d1-a4a2-3b4cfaa1802d tempest-VolumesActionsTest-846239010 None] Created volume successfully.
Nov 05 03:52:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 589f0b8e-d024-4dca-8311-763dc45c54e6: deleting
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 589f0b8e-d024-4dca-8311-763dc45c54e6: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4373}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-b5a1ef52-b955-46a5-84f0-529b76939c1a" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-b5a1ef52-b955-46a5-84f0-529b76939c1a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-4a6b8bf6-3787-4da1-9bac-c0695c63b699" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-4a6b8bf6-3787-4da1-9bac-c0695c63b699" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Deleting offline snapshot 4a6b8bf6-3787-4da1-9bac-c0695c63b699 of volume b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] snapshot_file for this snap is: volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7110c3-14a0-4f92-8b7a-115d118af69e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-e2f741df-93bb-4126-a33c-d72549e53852-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-e2f741df-93bb-4126-a33c-d72549e53852-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Acquiring lock "cinder-quobyte-e2f741df-93bb-4126-a33c-d72549e53852" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-e2f741df-93bb-4126-a33c-d72549e53852" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0980c710-074e-4eba-a537-086c23221971]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:19 devstack sudo[98306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699
Nov 05 03:52:19 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Flow 'volume_create_manager' (03a4edd8-7b9f-46f5-881c-197c848874f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0ce3f2-49a2-4505-8b8c-0ac1ace61153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0ce3f2-49a2-4505-8b8c-0ac1ace61153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-50150348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ae11e1-8820-4d4e-a1e5-5cc585a31851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f962381cdb1947ab91e4917d90abf6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:19Z,use_quota=True,user_id='1e0c6c1586d34e0bb82805f41cf3f245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5082db77-b768-43be-b55d-d7e7fda64250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5082db77-b768-43be-b55d-d7e7fda64250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40bb1d6-53c8-4871-923d-7357f6238cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40bb1d6-53c8-4871-923d-7357f6238cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ae11e1-8820-4d4e-a1e5-5cc585a31851', 'volume_name': 'volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc19cc37-d192-4350-bf7e-e41aacbf0535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc19cc37-d192-4350-bf7e-e41aacbf0535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3d8f08-8d60-45aa-af1f-5f7cef73122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Volume d3ae11e1-8820-4d4e-a1e5-5cc585a31851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851', 'volume_size': 1}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-50150348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ae11e1-8820-4d4e-a1e5-5cc585a31851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f962381cdb1947ab91e4917d90abf6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:19Z,use_quota=True,user_id='1e0c6c1586d34e0bb82805f41cf3f245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Creating volume d3ae11e1-8820-4d4e-a1e5-5cc585a31851 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:19 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:19 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851 1073741824
Nov 05 03:52:19 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:19 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852
Nov 05 03:52:19 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:19 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699" returned: 0 in 0.544s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5a1ef52-b955-46a5-84f0-529b76939c1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[587be82c-0775-41bf-8991-6645a8c9a2fa]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:19 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852" returned: 0 in 0.530s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:19 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a
Nov 05 03:52:19 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852
Nov 05 03:52:20 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851 1073741824" returned: 0 in 0.623s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:20 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a" returned: 0 in 0.511s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851
Nov 05 03:52:20 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:20 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699
Nov 05 03:52:20 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e2f741df-93bb-4126-a33c-d72549e53852" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-quobyte-e2f741df-93bb-4126-a33c-d72549e53852" released by "delete_volume" :: held 1.081s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Created reservations ['57b71b5d-3e84-4e5f-876a-964df01aade0', '911822ea-a20a-40a9-a75f-f4faa6cf550d', 'c652b899-d421-43f7-b32a-7baa4198ba97', 'a45f4911-deaf-4d99-a1e7-a9f3fe96eeab'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:20 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3d8f08-8d60-45aa-af1f-5f7cef73122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7e0317-5b95-48f1-91ce-19dde5390a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Volume volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851 (d3ae11e1-8820-4d4e-a1e5-5cc585a31851): created successfully
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7e0317-5b95-48f1-91ce-19dde5390a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Flow 'volume_create_manager' (03a4edd8-7b9f-46f5-881c-197c848874f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:20 devstack sudo[98338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:20 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-47074a06-2416-477a-a30c-51d078913bde tempest-VolumesTransfersV357Test-195888154 None] Created volume successfully.
Nov 05 03:52:20 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699" returned: 0 in 0.513s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:20 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699
Nov 05 03:52:20 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Deleted volume successfully.
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33c7058a-051c-4c19-bf76-082ad7ef8be4 tempest-VolumesActionsTest-1077012729 None] Lock "cinder-e2f741df-93bb-4126-a33c-d72549e53852-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:21 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a.4a6b8bf6-3787-4da1-9bac-c0695c63b699" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-4a6b8bf6-3787-4da1-9bac-c0695c63b699" released by "_delete_snapshot" :: held 2.075s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-b5a1ef52-b955-46a5-84f0-529b76939c1a" released by "delete_snapshot" :: held 2.116s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-17ffea0e-ff99-455f-b9f8-3c8ca946782a" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-17ffea0e-ff99-455f-b9f8-3c8ca946782a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-ec0df453-0791-4953-87bb-890e90d9b4aa" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-ec0df453-0791-4953-87bb-890e90d9b4aa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Deleting offline snapshot ec0df453-0791-4953-87bb-890e90d9b4aa of volume 17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] snapshot_file for this snap is: volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d8d20-4441-4682-a71e-db72a953d9a2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:21 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa
Nov 05 03:52:21 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:21 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[923b8819-a18f-48af-832a-e9a3a55dc7b9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:21 devstack sudo[98355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a
Nov 05 03:52:21 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:22 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (15a81b99-87e9-4016-a340-08ae3b29c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126719de-042f-4f10-8924-7857d0bfa88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a" returned: 0 in 0.605s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126719de-042f-4f10-8924-7857d0bfa88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108702934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04db7816-a957-4ea7-bb68-63de8af5b292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:22Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bf2ee3-c255-407f-b3b1-220abd0000bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:22 devstack sudo[98360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bf2ee3-c255-407f-b3b1-220abd0000bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:22 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4220115-a4dd-49f8-9c07-67202a35cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4220115-a4dd-49f8-9c07-67202a35cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04db7816-a957-4ea7-bb68-63de8af5b292', 'volume_name': 'volume-04db7816-a957-4ea7-bb68-63de8af5b292', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f57d765-518c-4384-b545-f7b56db7424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f57d765-518c-4384-b545-f7b56db7424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e4255a-114d-426b-8b46-79d4a859ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Volume 04db7816-a957-4ea7-bb68-63de8af5b292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04db7816-a957-4ea7-bb68-63de8af5b292', 'volume_size': 1}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108702934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04db7816-a957-4ea7-bb68-63de8af5b292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedcabf548bd4c8fb96308f9b3be513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:22Z,use_quota=True,user_id='0f99228550774c80b30e78c8a851a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Creating volume 04db7816-a957-4ea7-bb68-63de8af5b292 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:22 devstack sudo[98362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292 1073741824
Nov 05 03:52:22 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:22 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa" returned: 0 in 0.474s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7dc5f17f-5e4d-4da9-bf84-bcee1379466f tempest-VolumesTransfersV357Test-1664249741 None] Transfer volume completed successfully.
Nov 05 03:52:22 devstack sudo[98370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa
Nov 05 03:52:22 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:23 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292 1073741824" returned: 0 in 0.667s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:23 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292
Nov 05 03:52:23 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:23 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a.ec0df453-0791-4953-87bb-890e90d9b4aa" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-ec0df453-0791-4953-87bb-890e90d9b4aa" released by "_delete_snapshot" :: held 2.115s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-17ffea0e-ff99-455f-b9f8-3c8ca946782a" released by "delete_snapshot" :: held 2.142s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:23 devstack cinder-volume[87401]: WARNING cinder.quota [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-283764357 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-283764357, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:52:23 devstack cinder-volume[87401]: WARNING cinder.quota [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-283764357 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-283764357, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['6ae70dd0-a356-45c7-b4c1-a6c3b492dbb6', '9b57deda-0a9e-47bf-9a3e-fe429310c568', 'ca5244d7-206a-4b7d-a67e-5e5918eb47a3', 'cbf89fff-fcf8-4ce0-9761-86d91716a689'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:23 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e4255a-114d-426b-8b46-79d4a859ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04db7816-a957-4ea7-bb68-63de8af5b292', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6c6f74-accb-47a5-898c-495ff602704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Volume volume-04db7816-a957-4ea7-bb68-63de8af5b292 (04db7816-a957-4ea7-bb68-63de8af5b292): created successfully
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6c6f74-accb-47a5-898c-495ff602704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Flow 'volume_create_manager' (15a81b99-87e9-4016-a340-08ae3b29c32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-059fac77-eb69-4e37-8ddf-3a488bddf7d5 tempest-VolumesActionsTest-846239010 None] Created volume successfully.
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['331ef772-6a94-43e5-bf55-14160a02b225', '024b2f8a-7896-4221-8396-ad1ee2edef3b', '6b8d9589-8b2f-483e-8014-dd3582d5ac07', '16acdcde-ee3b-4484-a69b-631978d33d55'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Acquiring lock "cinder-d3ae11e1-8820-4d4e-a1e5-5cc585a31851-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-d3ae11e1-8820-4d4e-a1e5-5cc585a31851-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3fac3f7a-8ff3-46ca-b07c-e648e10bf448 tempest-GroupSnapshotsTest-1960754983 None] group_snapshot 589f0b8e-d024-4dca-8311-763dc45c54e6: deleted successfully
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Acquiring lock "cinder-quobyte-d3ae11e1-8820-4d4e-a1e5-5cc585a31851" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-quobyte-d3ae11e1-8820-4d4e-a1e5-5cc585a31851" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[352ffd7b-04f1-4af4-8a4f-1e868927fef6]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:24 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851
Nov 05 03:52:24 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:24 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:24 devstack sudo[98383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851
Nov 05 03:52:24 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:24 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d3ae11e1-8820-4d4e-a1e5-5cc585a31851" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-quobyte-d3ae11e1-8820-4d4e-a1e5-5cc585a31851" released by "delete_volume" :: held 0.871s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-17ffea0e-ff99-455f-b9f8-3c8ca946782a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-17ffea0e-ff99-455f-b9f8-3c8ca946782a" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e35346-e07d-4245-9822-19636b95cbc5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Created reservations ['92543569-20da-4221-b12b-7740f09d3123', '53735c6c-f9fa-408b-8bf8-e013a381126b', 'e009b65e-70fb-444c-9e5a-0744b0aac048', '87b500fd-9a2f-44a0-9fae-62b6c66d3cf9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:25 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:25 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:25 devstack sudo[98386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a
Nov 05 03:52:25 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Acquiring lock "cinder-04db7816-a957-4ea7-bb68-63de8af5b292-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Lock "cinder-04db7816-a957-4ea7-bb68-63de8af5b292-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:25 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Acquiring lock "cinder-quobyte-04db7816-a957-4ea7-bb68-63de8af5b292" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Deleted volume successfully.
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Lock "cinder-quobyte-04db7816-a957-4ea7-bb68-63de8af5b292" acquired by "delete_volume" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-157af3e1-0e56-4cd9-8487-97bef48e40d6 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-d3ae11e1-8820-4d4e-a1e5-5cc585a31851-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:25 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bd07ae-cbd9-44b4-970f-63260a2dcb4f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:25 devstack sudo[98394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a
Nov 05 03:52:25 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:25 devstack sudo[98395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292
Nov 05 03:52:25 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:25 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17ffea0e-ff99-455f-b9f8-3c8ca946782a" returned: 0 in 0.310s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-17ffea0e-ff99-455f-b9f8-3c8ca946782a" released by "delete_volume" :: held 0.952s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-b5a1ef52-b955-46a5-84f0-529b76939c1a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-b5a1ef52-b955-46a5-84f0-529b76939c1a" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[597bd2b9-5960-4975-8348-fd6b9ae6d8b7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:25 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:25 devstack sudo[98405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292
Nov 05 03:52:25 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:25 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a
Nov 05 03:52:25 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:26 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-04db7816-a957-4ea7-bb68-63de8af5b292" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Lock "cinder-quobyte-04db7816-a957-4ea7-bb68-63de8af5b292" released by "delete_volume" :: held 0.904s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Created reservations ['04d25149-92a8-4632-bd26-6f10e8d2bcb3', '8f26ca52-f27a-4360-9492-8f0411f610b8', '995e6625-4a47-4189-8041-8340b49041ca', 'be920723-ca79-408e-9d7d-8f45c5eefee5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:26 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a" returned: 0 in 0.603s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:26 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a
Nov 05 03:52:26 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:26 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:26 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:26 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Flow 'volume_create_manager' (88732806-0164-48bb-b9c0-bfeb4cd94c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:26 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687fb510-3f75-4493-bb00-444adbf86eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.331s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b5a1ef52-b955-46a5-84f0-529b76939c1a" returned: 0 in 0.429s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Deleted volume successfully.
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687fb510-3f75-4493-bb00-444adbf86eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2033262440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fcec54-7852-4686-9809-46e2f34de297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f962381cdb1947ab91e4917d90abf6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:27Z,use_quota=True,user_id='1e0c6c1586d34e0bb82805f41cf3f245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5826beb2-86c0-418f-8e00-fde7b56c4f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5826beb2-86c0-418f-8e00-fde7b56c4f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab313d2d-09a6-43ec-9baf-53040546667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab313d2d-09a6-43ec-9baf-53040546667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8fcec54-7852-4686-9809-46e2f34de297', 'volume_name': 'volume-a8fcec54-7852-4686-9809-46e2f34de297', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f637ac1-82a1-4131-b7c0-ef271c2c1303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f637ac1-82a1-4131-b7c0-ef271c2c1303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54acb002-132b-4b04-bc78-7949953f4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Volume a8fcec54-7852-4686-9809-46e2f34de297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8fcec54-7852-4686-9809-46e2f34de297', 'volume_size': 1}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2033262440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fcec54-7852-4686-9809-46e2f34de297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f962381cdb1947ab91e4917d90abf6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:27Z,use_quota=True,user_id='1e0c6c1586d34e0bb82805f41cf3f245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Creating volume a8fcec54-7852-4686-9809-46e2f34de297 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:26 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-b5a1ef52-b955-46a5-84f0-529b76939c1a" released by "delete_volume" :: held 1.185s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:26 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297 1073741824
Nov 05 03:52:26 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd49aa9b-662e-466f-a316-a89d7c603394 tempest-VolumesActionsTest-846239010 None] Lock "cinder-04db7816-a957-4ea7-bb68-63de8af5b292-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['553a91c6-d438-4f1f-a616-093e2c15fc16'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:27 devstack cinder-volume[87401]: WARNING cinder.quota [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-283764357 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-283764357, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['6c41001b-a808-4a37-a7bd-b483a08d2ddc', '24b546b3-cd4f-4c89-add7-253221b3be2b', 'ca33307d-8c96-49c2-a45e-51b49d8a9755', '741118be-ea16-42b8-b012-d60dc61a61b7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['1eca6db9-4253-4de3-b94f-76d4d4de6674', '7beb129a-20a4-410c-8b15-2e1cc5b3463e', '3dfdbdf4-75b8-4d39-bb8e-ffe563705892', 'df3ed49b-efbf-4047-8c96-e31009f19415'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:27 devstack sudo[98425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:27 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:27 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297 1073741824" returned: 0 in 0.543s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:27 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297
Nov 05 03:52:27 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:27 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a64372db-25fb-4304-bc3c-d637eaebdea7 tempest-GroupSnapshotsTest-1960754983 None] Delete group completed successfully.
Nov 05 03:52:27 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297" returned: 0 in 0.337s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54acb002-132b-4b04-bc78-7949953f4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fcec54-7852-4686-9809-46e2f34de297', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056c2a64-da64-48e0-93ce-a4a376f6e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Volume volume-a8fcec54-7852-4686-9809-46e2f34de297 (a8fcec54-7852-4686-9809-46e2f34de297): created successfully
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056c2a64-da64-48e0-93ce-a4a376f6e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Flow 'volume_create_manager' (88732806-0164-48bb-b9c0-bfeb4cd94c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6533a546-c609-4601-b5d6-ffce9d8e93c0 tempest-VolumesTransfersV357Test-195888154 None] Created volume successfully.
Nov 05 03:52:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f4449ae4-2ed6-4ab7-970b-402b16cc4c5b tempest-GroupSnapshotsTest-1960754983 None] Group tempest-GroupSnapshotsTest-Group-1985659915: creating
Nov 05 03:52:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f4449ae4-2ed6-4ab7-970b-402b16cc4c5b tempest-GroupSnapshotsTest-1960754983 None] Group tempest-GroupSnapshotsTest-Group-1985659915: created successfully
Nov 05 03:52:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f4449ae4-2ed6-4ab7-970b-402b16cc4c5b tempest-GroupSnapshotsTest-1960754983 None] Create group completed successfully.
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Acquiring lock "cinder-a8fcec54-7852-4686-9809-46e2f34de297-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-a8fcec54-7852-4686-9809-46e2f34de297-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Acquiring lock "cinder-quobyte-a8fcec54-7852-4686-9809-46e2f34de297" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-quobyte-a8fcec54-7852-4686-9809-46e2f34de297" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a5f7f0-936a-4433-9e26-3cea62628f57]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:29 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297
Nov 05 03:52:29 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:29 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:29 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297
Nov 05 03:52:29 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:30 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a8fcec54-7852-4686-9809-46e2f34de297" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-quobyte-a8fcec54-7852-4686-9809-46e2f34de297" released by "delete_volume" :: held 0.913s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Created reservations ['a59b2c54-680a-4dbc-8991-b62f51bc76d6', 'b4d2b6ee-6943-4ef1-94ba-6eb56fa83f94', '44bd128f-8abd-4cde-9455-13ff3417fc0d', '6ed09020-177e-4eaa-8553-8a6a42bee7ea'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:30 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:30 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (243cb7c1-74f5-42f4-9f77-0ebddacb1424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a749f440-0917-4547-9aed-6613e360af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a749f440-0917-4547-9aed-6613e360af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1550684688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd0961e8-0c87-42f1-b00d-fd070b48c3f9,host='devstack@QuobyteHD#QuobyteHD',id=bab495cc-4113-4d52-9da8-132ffb98ade4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:31Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(253b8ab9-ff45-499e-8535-9e4b8c62243f),volume_type_id=253b8ab9-ff45-499e-8535-9e4b8c62243f)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438ba7f6-cc48-4a95-b813-d78596643e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438ba7f6-cc48-4a95-b813-d78596643e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e65b8a5-d3f7-463e-bb47-8bc737b97782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e65b8a5-d3f7-463e-bb47-8bc737b97782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab495cc-4113-4d52-9da8-132ffb98ade4', 'volume_name': 'volume-bab495cc-4113-4d52-9da8-132ffb98ade4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564f8b68-b7ad-41a8-9ba3-afc72a09e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564f8b68-b7ad-41a8-9ba3-afc72a09e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5214ce87-ec55-4c28-8fe1-cbb0c701b096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:30 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Volume bab495cc-4113-4d52-9da8-132ffb98ade4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab495cc-4113-4d52-9da8-132ffb98ade4', 'volume_size': 1}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bd0961e8-0c87-42f1-b00d-fd070b48c3f9,created_at=2026-11-05T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1550684688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd0961e8-0c87-42f1-b00d-fd070b48c3f9,host='devstack@QuobyteHD#QuobyteHD',id=bab495cc-4113-4d52-9da8-132ffb98ade4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e84cd51e28e4764aaf170a6cbecc7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:31Z,use_quota=True,user_id='9f1d3d50e2834373889b9b72dc0db6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(253b8ab9-ff45-499e-8535-9e4b8c62243f),volume_type_id=253b8ab9-ff45-499e-8535-9e4b8c62243f)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Creating volume bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:31 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:31 devstack sudo[98444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 1073741824
Nov 05 03:52:31 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:31 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.425s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Deleted volume successfully.
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3368dd04-1170-4317-bb88-7f70c4085808 tempest-VolumesTransfersV357Test-616242103 None] Lock "cinder-a8fcec54-7852-4686-9809-46e2f34de297-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:31 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 1073741824" returned: 0 in 0.724s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:31 devstack sudo[98451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4
Nov 05 03:52:31 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:32 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=180,cinder:UPDATE=210,cinder:INSERT=49,cinder:DELETE=13 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5214ce87-ec55-4c28-8fe1-cbb0c701b096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab495cc-4113-4d52-9da8-132ffb98ade4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12095f30-e071-452f-ac58-285a79d0b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=189,cinder:UPDATE=208,cinder:INSERT=50,cinder:DELETE=11 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:52:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Volume volume-bab495cc-4113-4d52-9da8-132ffb98ade4 (bab495cc-4113-4d52-9da8-132ffb98ade4): created successfully
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12095f30-e071-452f-ac58-285a79d0b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Flow 'volume_create_manager' (243cb7c1-74f5-42f4-9f77-0ebddacb1424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-72d61cfa-a4a9-490b-ac01-ccf84f8b7fd0 tempest-GroupSnapshotsTest-1960754983 None] Created volume successfully.
Nov 05 03:52:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] GroupSnapshot b6beb380-f891-4790-98ce-a35893a7ad49: creating.
Nov 05 03:52:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Group snapshot b6beb380-f891-4790-98ce-a35893a7ad49: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4198}}
Nov 05 03:52:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Creating offline snapshot 04f21547-1f04-4154-9cc7-84a56711066e of volume bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e48dfa1-4f45-4547-a391-5e7f6d5843d2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:33 devstack sudo[98454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4
Nov 05 03:52:33 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:34 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4" returned: 0 in 0.530s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:34 devstack sudo[98465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e 1G
Nov 05 03:52:34 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:34 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e 1G" returned: 0 in 0.517s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab495cc-4113-4d52-9da8-132ffb98ade4 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:34 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab495cc-4113-4d52-9da8-132ffb98ade4 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e
Nov 05 03:52:34 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Flow 'volume_create_manager' (1ff47305-b69a-499e-9f7f-4a8a37e8a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278abf2d-6fbc-41b5-b727-1b3c42d2d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278abf2d-6fbc-41b5-b727-1b3c42d2d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1771663600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc60ccc-3b9c-4852-a964-a9df365aab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028549ea014440f7b5ac4ff70908753f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:35Z,use_quota=True,user_id='0c8a343008f74e7a8c81eef78948030a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dcf684-818e-4b28-9776-ad6d7afb93c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dcf684-818e-4b28-9776-ad6d7afb93c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38731248-b22e-4a42-9e99-afc06df86e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38731248-b22e-4a42-9e99-afc06df86e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc60ccc-3b9c-4852-a964-a9df365aab3e', 'volume_name': 'volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:35 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bd2c06-063a-43b1-8968-6bed02613236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bd2c06-063a-43b1-8968-6bed02613236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96487685-fb3b-4686-b0c6-1dda4203ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Volume 2bc60ccc-3b9c-4852-a964-a9df365aab3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e', 'volume_size': 1}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab495cc-4113-4d52-9da8-132ffb98ade4 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e" returned: 0 in 0.363s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:35 devstack sudo[98476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e
Nov 05 03:52:35 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:35 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:35 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.info
Nov 05 03:52:35 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:35 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.info" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:52:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:35 devstack sudo[98482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.info
Nov 05 03:52:35 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:36 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.info" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1771663600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc60ccc-3b9c-4852-a964-a9df365aab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028549ea014440f7b5ac4ff70908753f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:35Z,use_quota=True,user_id='0c8a343008f74e7a8c81eef78948030a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Creating volume 2bc60ccc-3b9c-4852-a964-a9df365aab3e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:36 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:36 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e 1073741824
Nov 05 03:52:36 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-223ba820-e8b4-4eb4-be44-6541591cc814 tempest-GroupSnapshotsTest-1960754983 None] group_snapshot b6beb380-f891-4790-98ce-a35893a7ad49: created successfully
Nov 05 03:52:36 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e 1073741824" returned: 0 in 0.612s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:36 devstack sudo[98491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e
Nov 05 03:52:36 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:37 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96487685-fb3b-4686-b0c6-1dda4203ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d53d5ec-706c-467c-b084-471beb209d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] group_snapshot b6beb380-f891-4790-98ce-a35893a7ad49: deleting
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] group_snapshot b6beb380-f891-4790-98ce-a35893a7ad49: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4373}}
Nov 05 03:52:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Volume volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e (2bc60ccc-3b9c-4852-a964-a9df365aab3e): created successfully
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d53d5ec-706c-467c-b084-471beb209d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Flow 'volume_create_manager' (1ff47305-b69a-499e-9f7f-4a8a37e8a36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-88a725d3-69d9-4671-a364-44c148f424c5 tempest-TestImageHashVerification-186220592 None] Created volume successfully.
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-bab495cc-4113-4d52-9da8-132ffb98ade4" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-bab495cc-4113-4d52-9da8-132ffb98ade4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-04f21547-1f04-4154-9cc7-84a56711066e" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-04f21547-1f04-4154-9cc7-84a56711066e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Deleting offline snapshot 04f21547-1f04-4154-9cc7-84a56711066e of volume bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] snapshot_file for this snap is: volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e0a180-ed1a-4f4b-85cf-21c628d7cfec]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:37 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e
Nov 05 03:52:37 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:37 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab495cc-4113-4d52-9da8-132ffb98ade4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eb134d-c1ee-4c36-a07e-074cc117f26a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:38 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4
Nov 05 03:52:38 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:38 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:38 devstack sudo[98505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e
Nov 05 03:52:38 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:38 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e" returned: 0 in 0.447s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:38 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e
Nov 05 03:52:38 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:39 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4.04f21547-1f04-4154-9cc7-84a56711066e" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-04f21547-1f04-4154-9cc7-84a56711066e" released by "_delete_snapshot" :: held 1.810s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-bab495cc-4113-4d52-9da8-132ffb98ade4" released by "delete_snapshot" :: held 1.848s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:39 devstack cinder-volume[87401]: WARNING cinder.quota [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-513510948 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-513510948, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:52:39 devstack cinder-volume[87401]: WARNING cinder.quota [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-513510948 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-513510948, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['5461775f-f0f2-4a68-b799-1eb4f575ea05', '64ab5b4a-db1d-4ccd-8515-e50c041b1a87', '9862e38a-9442-40e0-9786-f32248a36f40', '16f6d6ec-eb2d-4884-970b-aa6bb4a5a757'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-edbd7a3a-e8b6-44f2-8ebb-69d4dd6fce2d tempest-GroupSnapshotsTest-1960754983 None] group_snapshot b6beb380-f891-4790-98ce-a35893a7ad49: deleted successfully
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf5ed82-d44f-408b-8009-ba54d52ef94f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:39 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e
Nov 05 03:52:39 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:40 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e" returned: 0 in 0.516s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[64574724-6a1a-48cd-bd13-67659be63bc9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "cinder-quobyte-bab495cc-4113-4d52-9da8-132ffb98ade4" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-bab495cc-4113-4d52-9da8-132ffb98ade4" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db2c38f-de30-4a9c-b45f-4fb57b27b673]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:40 devstack sudo[98520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e
Nov 05 03:52:40 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:40 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4
Nov 05 03:52:40 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:40 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e" returned: 0 in 0.639s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e /opt/stack/data/cinder/conversion/2bc60ccc-3b9c-4852-a964-a9df365aab3e.temp_image.64f5099f-a805-44e0-9fd9-a9912e90c514xv66pnde.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:40 devstack sudo[98562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e /opt/stack/data/cinder/conversion/2bc60ccc-3b9c-4852-a964-a9df365aab3e.temp_image.64f5099f-a805-44e0-9fd9-a9912e90c514xv66pnde.img
Nov 05 03:52:40 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:40 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4" returned: 0 in 0.601s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:40 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4
Nov 05 03:52:40 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:41 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bab495cc-4113-4d52-9da8-132ffb98ade4" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Lock "cinder-quobyte-bab495cc-4113-4d52-9da8-132ffb98ade4" released by "delete_volume" :: held 1.066s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['8555bf58-1137-44b7-9ce8-8ecd25eb4b18'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:41 devstack cinder-volume[87401]: WARNING cinder.quota [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-513510948 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-513510948, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Created reservations ['800fc47b-b35c-4d06-aea8-1df9cf0471eb', '6efef271-c119-45f7-a5d6-82f4496ef0e1', '38a8eaff-20b0-466b-b6ee-04d0f9e1ecd6', 'eba63b26-a2c5-4348-8439-ba7c092469a0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:41 devstack sudo[98581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:52:41 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:42 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.687s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:42 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0ab5838c-9561-476e-94a7-a0e398ba6c5b tempest-GroupSnapshotsTest-1960754983 None] Delete group completed successfully.
Nov 05 03:52:49 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e /opt/stack/data/cinder/conversion/2bc60ccc-3b9c-4852-a964-a9df365aab3e.temp_image.64f5099f-a805-44e0-9fd9-a9912e90c514xv66pnde.img" returned: 0 in 8.556s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[03496abc-e258-4eb8-b9b7-81f777607ed3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:49 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e
Nov 05 03:52:49 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:49 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e" returned: 0 in 0.649s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:49 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e, size 1024.00 MB, duration 8.56 sec, destination /opt/stack/data/cinder/conversion/2bc60ccc-3b9c-4852-a964-a9df365aab3e.temp_image.64f5099f-a805-44e0-9fd9-a9912e90c514xv66pnde.img {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:52:49 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Converted 1024.00 MB image at 119.62 MB/s
Nov 05 03:52:49 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] 64f5099f-a805-44e0-9fd9-a9912e90c514 was raw, no need to convert to raw {{(pid=87401) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Nov 05 03:52:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Flow 'volume_create_manager' (5d4bf973-54c3-4cb1-bba3-a4fee0a52279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9df5b6c-2a7d-4933-8b84-00103711796f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9df5b6c-2a7d-4933-8b84-00103711796f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31050795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b57e575-c942-40a2-86ac-e5eb02e5756b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a46c866c1dc4ef6b42dede42ceb48a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:58Z,use_quota=True,user_id='8b3914a814bb4d91b90d52608cd8886a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d19707-0e35-4c6b-ad4c-d1a031cf8a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d19707-0e35-4c6b-ad4c-d1a031cf8a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd46319-2f88-4234-84aa-14db4b468069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd46319-2f88-4234-84aa-14db4b468069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b57e575-c942-40a2-86ac-e5eb02e5756b', 'volume_name': 'volume-1b57e575-c942-40a2-86ac-e5eb02e5756b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd9a19d-03ed-499a-99e7-0ba12c4a36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd9a19d-03ed-499a-99e7-0ba12c4a36f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a07ab5e-dcf6-49fc-a75a-2ec8d102f9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Volume 1b57e575-c942-40a2-86ac-e5eb02e5756b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b57e575-c942-40a2-86ac-e5eb02e5756b', 'volume_size': 1}
Nov 05 03:52:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Flow 'volume_create_manager' (3fb5a15f-5b0f-4092-a292-6db64565049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2e7d77-9e1c-4eda-bf75-f64025ea3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2e7d77-9e1c-4eda-bf75-f64025ea3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-866671024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd681058-0a27-413e-8e86-216edfdb6804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6803d6f26c13401ebda99c85f6020ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:02Z,use_quota=True,user_id='374a8a8d543e443a922f9c08a1ebf2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d49ca9-4b1b-46db-8bcd-924e91d55bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d49ca9-4b1b-46db-8bcd-924e91d55bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6ace25-8d6d-44af-bbce-d1f6bcfe31f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6ace25-8d6d-44af-bbce-d1f6bcfe31f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd681058-0a27-413e-8e86-216edfdb6804', 'volume_name': 'volume-fd681058-0a27-413e-8e86-216edfdb6804', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab526f410>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6ebff2-ccc7-4615-ac23-f94e9f33a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6ebff2-ccc7-4615-ac23-f94e9f33a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abf277e-d8e1-4f3c-a00d-1b5918119ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Volume fd681058-0a27-413e-8e86-216edfdb6804: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd681058-0a27-413e-8e86-216edfdb6804', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab526f410>}
Nov 05 03:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Trying to clone fd681058-0a27-413e-8e86-216edfdb6804 from image be17f312-5d93-463e-be81-a5040fe456d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:53:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:53:03 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:53:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a538099e-7d99-482a-bfac-e4f2daed3c4a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:03 devstack sudo[98596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD
Nov 05 03:53:03 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:04 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:04 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 is fetched for user 374a8a8d543e443a922f9c08a1ebf2c6. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:53:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e804335a-9b7e-4105-aa5a-e113cd0c40ec]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:04 devstack sudo[98602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD
Nov 05 03:53:04 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:04 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Flow 'volume_create_manager' (a1bb6698-e39a-45c7-8e73-2991f5fd6c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab6d1c6-3af3-4a67-9de1-764445feb9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab6d1c6-3af3-4a67-9de1-764445feb9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-568570716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938b3d6a-6494-48a1-b019-86587ad3b15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285e6b0631dc434a91fc8d4698809bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:05Z,use_quota=True,user_id='132f2bb51f6f4a1a950f8b154b13f203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd616cb6-b94b-47d2-967d-10090986eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd616cb6-b94b-47d2-967d-10090986eea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6c9cf-79e7-419a-a6dc-0e86a4496868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6c9cf-79e7-419a-a6dc-0e86a4496868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938b3d6a-6494-48a1-b019-86587ad3b15e', 'volume_name': 'volume-938b3d6a-6494-48a1-b019-86587ad3b15e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c446d9a2-29b6-43fd-a8df-7b27391617b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c446d9a2-29b6-43fd-a8df-7b27391617b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff1ca1b-f927-4cf7-984c-1ca21e05d4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Volume 938b3d6a-6494-48a1-b019-86587ad3b15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938b3d6a-6494-48a1-b019-86587ad3b15e', 'volume_size': 1}
Nov 05 03:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:10 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:53:10 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:10 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.323s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:53:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.207s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Uploaded volume to glance image-id: 64f5099f-a805-44e0-9fd9-a9912e90c514. {{(pid=87401) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.055s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31050795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b57e575-c942-40a2-86ac-e5eb02e5756b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a46c866c1dc4ef6b42dede42ceb48a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:58Z,use_quota=True,user_id='8b3914a814bb4d91b90d52608cd8886a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Creating volume 1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:13 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:13 devstack sudo[98611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b 1073741824
Nov 05 03:53:13 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-eb8620f2-dfc9-4f67-ab0b-8be58d68742c tempest-TestImageHashVerification-186220592 None] Copy volume to image completed successfully.
Nov 05 03:53:14 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b 1073741824" returned: 0 in 0.453s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:14 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:53:14 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:14 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.248s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.765s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-866671024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd681058-0a27-413e-8e86-216edfdb6804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6803d6f26c13401ebda99c85f6020ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:02Z,use_quota=True,user_id='374a8a8d543e443a922f9c08a1ebf2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Creating volume fd681058-0a27-413e-8e86-216edfdb6804 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:14 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:14 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 1073741824
Nov 05 03:53:14 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a07ab5e-dcf6-49fc-a75a-2ec8d102f9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b57e575-c942-40a2-86ac-e5eb02e5756b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769a86af-5c7d-462a-9c6d-76fb0fc7978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Volume volume-1b57e575-c942-40a2-86ac-e5eb02e5756b (1b57e575-c942-40a2-86ac-e5eb02e5756b): created successfully
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769a86af-5c7d-462a-9c6d-76fb0fc7978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Flow 'volume_create_manager' (5d4bf973-54c3-4cb1-bba3-a4fee0a52279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-28b5fe9f-0011-4e9a-8a41-1a833c43545b tempest-VolumesActionsTest-868452643 None] Created volume successfully.
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Acquiring lock "cinder-2bc60ccc-3b9c-4852-a964-a9df365aab3e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Lock "cinder-2bc60ccc-3b9c-4852-a964-a9df365aab3e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Acquiring lock "cinder-quobyte-2bc60ccc-3b9c-4852-a964-a9df365aab3e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Lock "cinder-quobyte-2bc60ccc-3b9c-4852-a964-a9df365aab3e" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa848944-f8ee-49a4-876b-cf19e3dc3e30]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:14 devstack sudo[98625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e
Nov 05 03:53:14 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:14 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 1073741824" returned: 0 in 0.494s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:14 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804
Nov 05 03:53:14 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:15 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e" returned: 0 in 0.383s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:15 devstack sudo[98632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e
Nov 05 03:53:15 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:15 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.817s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-568570716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938b3d6a-6494-48a1-b019-86587ad3b15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285e6b0631dc434a91fc8d4698809bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:05Z,use_quota=True,user_id='132f2bb51f6f4a1a950f8b154b13f203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Creating volume 938b3d6a-6494-48a1-b019-86587ad3b15e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:15 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:15 devstack sudo[98635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e 1073741824
Nov 05 03:53:15 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Attempting download of be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume fd681058-0a27-413e-8e86-216edfdb6804. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd1d2b5-a2e3-49cc-b880-426792c9de73]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_ihlpm9m_ {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:15 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2bc60ccc-3b9c-4852-a964-a9df365aab3e" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Lock "cinder-quobyte-2bc60ccc-3b9c-4852-a964-a9df365aab3e" released by "delete_volume" :: held 0.701s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Created reservations ['373fe327-7935-4585-8763-a3468277e4fe', '5e8f6486-afd3-4f2a-abc3-89916ce6a20d', '55e7891a-7255-44a9-af43-4ec01370f84d', 'abc4c0f0-4f1b-4277-a1c1-91b790ef97a8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:15 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_ihlpm9m_
Nov 05 03:53:15 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:15 devstack sudo[98643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:53:15 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:15 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_ihlpm9m_" returned: 0 in 0.453s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_ihlpm9m_ {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:15 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e 1073741824" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:15 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:15 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e
Nov 05 03:53:15 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Deleted volume successfully.
Nov 05 03:53:15 devstack sudo[98648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_ihlpm9m_
Nov 05 03:53:15 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21def372-85fd-497b-9ab7-7b34102a751c tempest-TestImageHashVerification-186220592 None] Lock "cinder-2bc60ccc-3b9c-4852-a964-a9df365aab3e-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:16 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff1ca1b-f927-4cf7-984c-1ca21e05d4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938b3d6a-6494-48a1-b019-86587ad3b15e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ff6a99-f550-410d-bd6e-b0f5c2e98bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:16 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Volume volume-938b3d6a-6494-48a1-b019-86587ad3b15e (938b3d6a-6494-48a1-b019-86587ad3b15e): created successfully
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ff6a99-f550-410d-bd6e-b0f5c2e98bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Flow 'volume_create_manager' (a1bb6698-e39a-45c7-8e73-2991f5fd6c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_ihlpm9m_" returned: 1 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_ihlpm9m_' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28f383e-5b44-4c3a-8da9-3ec028619b54]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-73488192-657e-44ee-bbfd-50c78d70fc30 tempest-VolumesServicesTestJSON-533084988 None] Created volume successfully.
Nov 05 03:53:16 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD
Nov 05 03:53:16 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:16 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] be17f312-5d93-463e-be81-a5040fe456d8 was qcow2, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:16 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804
Nov 05 03:53:16 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Acquiring lock "cinder-938b3d6a-6494-48a1-b019-86587ad3b15e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Lock "cinder-938b3d6a-6494-48a1-b019-86587ad3b15e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Acquiring lock "cinder-quobyte-938b3d6a-6494-48a1-b019-86587ad3b15e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Lock "cinder-quobyte-938b3d6a-6494-48a1-b019-86587ad3b15e" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[33004a8c-7d78-4100-a347-bc0a415f4236]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:17 devstack sudo[98673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e
Nov 05 03:53:17 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:18 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e" returned: 0 in 0.598s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:18 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e
Nov 05 03:53:18 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:18 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-938b3d6a-6494-48a1-b019-86587ad3b15e" returned: 0 in 0.384s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Lock "cinder-quobyte-938b3d6a-6494-48a1-b019-86587ad3b15e" released by "delete_volume" :: held 1.050s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Created reservations ['b07d4f65-2cf0-4232-a0b9-bf1aad7850c6', '566baa2b-d793-4144-b921-70ff1393b07a', 'cadfbe88-d1ec-4ce6-b5de-106c3847a510', '30cd6e20-c113-41f9-b0d9-cd302d739109'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:18 devstack sudo[98685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:53:18 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:19 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:19 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Deleted volume successfully.
Nov 05 03:53:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa625cff-bf3e-4e31-842f-2795776ac7f1 tempest-VolumesServicesTestJSON-533084988 None] Lock "cinder-938b3d6a-6494-48a1-b019-86587ad3b15e-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:19 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804" returned: 0 in 3.123s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:19 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_uafpyrs9devstack@QuobyteHD, size 112.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:53:19 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Converted 112.00 MB image at 35.85 MB/s
Nov 05 03:53:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:19 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 1G
Nov 05 03:53:19 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:20 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 1G" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Downloaded image be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume fd681058-0a27-413e-8e86-216edfdb6804 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 for user 374a8a8d543e443a922f9c08a1ebf2c6 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Marking volume fd681058-0a27-413e-8e86-216edfdb6804 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Copying metadata from image be17f312-5d93-463e-be81-a5040fe456d8 to fd681058-0a27-413e-8e86-216edfdb6804. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Creating volume glance metadata for volume fd681058-0a27-413e-8e86-216edfdb6804 backed by image be17f312-5d93-463e-be81-a5040fe456d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abf277e-d8e1-4f3c-a00d-1b5918119ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd681058-0a27-413e-8e86-216edfdb6804', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab526f410>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22be693d-3b6f-48eb-a24e-bcab7e0db13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Volume volume-fd681058-0a27-413e-8e86-216edfdb6804 (fd681058-0a27-413e-8e86-216edfdb6804): created successfully
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22be693d-3b6f-48eb-a24e-bcab7e0db13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Flow 'volume_create_manager' (3fb5a15f-5b0f-4092-a292-6db64565049c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-029c30c7-6f4c-4528-9859-5bc931cefd2b tempest-VolumesImageMetadata-754020100 None] Created volume successfully.
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Acquiring lock "cinder-fd681058-0a27-413e-8e86-216edfdb6804-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Lock "cinder-fd681058-0a27-413e-8e86-216edfdb6804-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Acquiring lock "cinder-quobyte-fd681058-0a27-413e-8e86-216edfdb6804" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Lock "cinder-quobyte-fd681058-0a27-413e-8e86-216edfdb6804" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ce46c1-4777-40e1-a876-8744000f7f92]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:22 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804
Nov 05 03:53:22 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:22 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804" returned: 0 in 0.494s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:23 devstack sudo[98722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804
Nov 05 03:53:23 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:23 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-fd681058-0a27-413e-8e86-216edfdb6804" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Lock "cinder-quobyte-fd681058-0a27-413e-8e86-216edfdb6804" released by "delete_volume" :: held 0.975s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Created reservations ['ab68ac80-32a6-473c-abb1-d3be9c5df328', 'ff3217a7-fd95-4a99-884e-ab007081cf98', '889bd830-5f2b-4108-a902-bf075061ecb9', '52bb6d57-411d-416f-9f4a-6e2ff2bb1ab7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:23 devstack sudo[98725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:53:23 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:23 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:23 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Deleted volume successfully.
Nov 05 03:53:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cffe85ca-4112-4e11-b4db-1d2ee1aad1b6 tempest-VolumesImageMetadata-754020100 None] Lock "cinder-fd681058-0a27-413e-8e86-216edfdb6804-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f54f803-8217-4bba-b1ee-b16ed8a0a987 tempest-VolumesActionsTest-868452643 None] Acquiring lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b" by "attach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f54f803-8217-4bba-b1ee-b16ed8a0a987 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b" acquired by "attach_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2f54f803-8217-4bba-b1ee-b16ed8a0a987 tempest-VolumesActionsTest-868452643 None] Attaching volume 1b57e575-c942-40a2-86ac-e5eb02e5756b to instance 6e5ddef6-c3a4-4ee8-8ada-7c228f8e0779 at mountpoint /dev/vdb on host None.
Nov 05 03:53:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2f54f803-8217-4bba-b1ee-b16ed8a0a987 tempest-VolumesActionsTest-868452643 None] Attach volume completed successfully.
Nov 05 03:53:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f54f803-8217-4bba-b1ee-b16ed8a0a987 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b" released by "attach_volume" :: held 0.151s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3f3a8bf-20a0-41ec-8a73-dec1a1754765 tempest-VolumesActionsTest-868452643 None] Acquiring lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3f3a8bf-20a0-41ec-8a73-dec1a1754765 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c3f3a8bf-20a0-41ec-8a73-dec1a1754765 tempest-VolumesActionsTest-868452643 None] Detaching volume 1b57e575-c942-40a2-86ac-e5eb02e5756b from instance 6e5ddef6-c3a4-4ee8-8ada-7c228f8e0779.
Nov 05 03:53:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c3f3a8bf-20a0-41ec-8a73-dec1a1754765 tempest-VolumesActionsTest-868452643 None] Detach volume completed successfully.
Nov 05 03:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3f3a8bf-20a0-41ec-8a73-dec1a1754765 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Flow 'volume_create_manager' (e09c3759-2b6c-4bae-9eda-7384c4e293fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87370bd3-f246-41dd-a2d2-d58886c04ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87370bd3-f246-41dd-a2d2-d58886c04ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-939005541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29401d23-1fa6-4388-8642-e46a7c6c2995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf7d87576f4fa2aaa0c62fbd80c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:32Z,use_quota=True,user_id='e1d0367b8cb14bfd99295d671133874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620ed00c-e0b8-4606-aca7-80f14ced0d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620ed00c-e0b8-4606-aca7-80f14ced0d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec9b961-ad58-465b-8b2a-0321053a883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec9b961-ad58-465b-8b2a-0321053a883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29401d23-1fa6-4388-8642-e46a7c6c2995', 'volume_name': 'volume-29401d23-1fa6-4388-8642-e46a7c6c2995', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ffb742-2445-4850-ac93-e3440bd236d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ffb742-2445-4850-ac93-e3440bd236d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7a28d2-69a6-4299-8aba-59853af70c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Volume 29401d23-1fa6-4388-8642-e46a7c6c2995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29401d23-1fa6-4388-8642-e46a7c6c2995', 'volume_size': 1}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-939005541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29401d23-1fa6-4388-8642-e46a7c6c2995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf7d87576f4fa2aaa0c62fbd80c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:32Z,use_quota=True,user_id='e1d0367b8cb14bfd99295d671133874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Creating volume 29401d23-1fa6-4388-8642-e46a7c6c2995 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:32 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:32 devstack sudo[98821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995 1073741824
Nov 05 03:53:32 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:33 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995 1073741824" returned: 0 in 0.636s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=64,cinder:DELETE=2,cinder:SELECT=63,cinder:INSERT=22 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:33 devstack sudo[98827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995
Nov 05 03:53:33 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:33 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995" returned: 0 in 0.459s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7a28d2-69a6-4299-8aba-59853af70c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29401d23-1fa6-4388-8642-e46a7c6c2995', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fbf21e-0026-4777-a9da-158cb98f1ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Volume volume-29401d23-1fa6-4388-8642-e46a7c6c2995 (29401d23-1fa6-4388-8642-e46a7c6c2995): created successfully
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fbf21e-0026-4777-a9da-158cb98f1ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Flow 'volume_create_manager' (e09c3759-2b6c-4bae-9eda-7384c4e293fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d771c989-4134-48be-9f27-9bcd29c3d4ab tempest-VolumesTransfersV355Test-1340172289 None] Created volume successfully.
Nov 05 03:53:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-10bfc2e7-ae5a-4915-ad8d-43305e49a7e6 tempest-VolumesTransfersV355Test-682320579 None] Transfer volume completed successfully.
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Acquiring lock "cinder-29401d23-1fa6-4388-8642-e46a7c6c2995-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-29401d23-1fa6-4388-8642-e46a7c6c2995-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Acquiring lock "cinder-quobyte-29401d23-1fa6-4388-8642-e46a7c6c2995" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-quobyte-29401d23-1fa6-4388-8642-e46a7c6c2995" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1f5abf-61bf-427a-9d4e-cd7fd1e1ba4f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:37 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995
Nov 05 03:53:37 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:37 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995" returned: 0 in 0.658s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:38 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995
Nov 05 03:53:38 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:38 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-29401d23-1fa6-4388-8642-e46a7c6c2995" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-quobyte-29401d23-1fa6-4388-8642-e46a7c6c2995" released by "delete_volume" :: held 1.206s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Created reservations ['560ade16-c62a-4649-86f6-a1915750e4bd', '9c7d326d-b533-47df-817f-f115f3207c80', 'abf442cd-26e5-4519-9e49-fa2a71de6b08', 'c87b1aa8-e979-46f7-83ec-498db6c3fb12'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:38 devstack sudo[98864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:53:38 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Flow 'volume_create_manager' (f87d61e9-bd76-4823-ae2a-fa9b173442f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89954472-7761-4013-b1c9-f4cb77e58ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89954472-7761-4013-b1c9-f4cb77e58ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1433976302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2056c6ea-bc5b-4b83-9f85-fd74037ec4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd960de61384d14803ffd41bd691181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:39Z,use_quota=True,user_id='355fcbbe88734a9b8181e9d24b09556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f9252d-b863-461c-84be-a0d26f4f5762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f9252d-b863-461c-84be-a0d26f4f5762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:39 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76100c73-fbd3-4b01-bafb-802ccbd6dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76100c73-fbd3-4b01-bafb-802ccbd6dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2056c6ea-bc5b-4b83-9f85-fd74037ec4d4', 'volume_name': 'volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de62b5d-09ea-473b-af36-089908612cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de62b5d-09ea-473b-af36-089908612cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860d5fe-bf21-400d-b78b-fabbcc3c61ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:39 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Volume 2056c6ea-bc5b-4b83-9f85-fd74037ec4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4', 'volume_size': 1}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1433976302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2056c6ea-bc5b-4b83-9f85-fd74037ec4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd960de61384d14803ffd41bd691181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:39Z,use_quota=True,user_id='355fcbbe88734a9b8181e9d24b09556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Creating volume 2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:39 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Deleted volume successfully.
Nov 05 03:53:39 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 1073741824
Nov 05 03:53:39 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-120d5ba8-8d1d-45b0-993f-ff6d59f3c14b tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-29401d23-1fa6-4388-8642-e46a7c6c2995-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:39 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 1073741824" returned: 0 in 0.656s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:39 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4
Nov 05 03:53:39 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:40 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Flow 'volume_create_manager' (fc0276ce-0301-4233-bcdd-e9eac39f73e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b559276-9d21-44ae-8dd1-90b0c9df5d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" returned: 0 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b559276-9d21-44ae-8dd1-90b0c9df5d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-509923314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf076cc-f795-453f-a4d0-3f4b08c16cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf7d87576f4fa2aaa0c62fbd80c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:40Z,use_quota=True,user_id='e1d0367b8cb14bfd99295d671133874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adf61af-dee1-4479-831b-662cb79c5bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adf61af-dee1-4479-831b-662cb79c5bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0713832-a673-4b36-a6bc-e2a61858b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0713832-a673-4b36-a6bc-e2a61858b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf076cc-f795-453f-a4d0-3f4b08c16cc3', 'volume_name': 'volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bd48af-9e02-4621-a962-503331766d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bd48af-9e02-4621-a962-503331766d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a9ccbe-eaef-4b26-bfbf-5c2b6cf205c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Volume 6cf076cc-f795-453f-a4d0-3f4b08c16cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3', 'volume_size': 1}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-509923314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf076cc-f795-453f-a4d0-3f4b08c16cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf7d87576f4fa2aaa0c62fbd80c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:40Z,use_quota=True,user_id='e1d0367b8cb14bfd99295d671133874a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Creating volume 6cf076cc-f795-453f-a4d0-3f4b08c16cc3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:40 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860d5fe-bf21-400d-b78b-fabbcc3c61ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742eb219-63a5-4ad0-98f3-83cc5e2bb9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack sudo[98877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3 1073741824
Nov 05 03:53:40 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Volume volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 (2056c6ea-bc5b-4b83-9f85-fd74037ec4d4): created successfully
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742eb219-63a5-4ad0-98f3-83cc5e2bb9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Flow 'volume_create_manager' (f87d61e9-bd76-4823-ae2a-fa9b173442f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5f1f4d64-8148-4ed1-94bc-5f9c38e5a67f tempest-VolumeDependencyTests-784627332 None] Created volume successfully.
Nov 05 03:53:41 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3 1073741824" returned: 0 in 0.626s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:41 devstack sudo[98918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3
Nov 05 03:53:41 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:41 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3" returned: 0 in 0.429s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a9ccbe-eaef-4b26-bfbf-5c2b6cf205c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c7855b-5c84-46e5-8ec6-329acfec63fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Volume volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3 (6cf076cc-f795-453f-a4d0-3f4b08c16cc3): created successfully
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c7855b-5c84-46e5-8ec6-329acfec63fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Flow 'volume_create_manager' (fc0276ce-0301-4233-bcdd-e9eac39f73e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Creating offline snapshot ae398428-9cd5-4667-8f08-d4f85579db3f of volume 2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:53:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ccaf6916-8c73-46e8-b0b3-c3435df51433 tempest-VolumesTransfersV355Test-1340172289 None] Created volume successfully.
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ef3923-0cfa-4223-a8b0-49ae343234d5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:41 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4
Nov 05 03:53:41 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:42 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:42 devstack sudo[98928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f 1G
Nov 05 03:53:42 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Acquiring lock "cinder-6cf076cc-f795-453f-a4d0-3f4b08c16cc3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-6cf076cc-f795-453f-a4d0-3f4b08c16cc3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:43 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f 1G" returned: 0 in 0.903s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Acquiring lock "cinder-quobyte-6cf076cc-f795-453f-a4d0-3f4b08c16cc3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:43 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f
Nov 05 03:53:43 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-quobyte-6cf076cc-f795-453f-a4d0-3f4b08c16cc3" acquired by "delete_volume" :: waited 0.057s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[54761134-438f-4a91-8f4c-cf67e6aff6ca]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:43 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3
Nov 05 03:53:43 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:43 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f" returned: 0 in 0.614s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:43 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f is being set with open permissions: ugo+rw
Nov 05 03:53:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:43 devstack sudo[98999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f
Nov 05 03:53:43 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:44 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3" returned: 0 in 0.835s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:44 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3
Nov 05 03:53:44 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:44 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f" returned: 0 in 0.653s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:44 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.info
Nov 05 03:53:44 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:44 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6cf076cc-f795-453f-a4d0-3f4b08c16cc3" returned: 0 in 0.667s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-quobyte-6cf076cc-f795-453f-a4d0-3f4b08c16cc3" released by "delete_volume" :: held 1.598s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Created reservations ['99dd606b-022e-46ec-9ee4-7fe844366763', 'f4dd4703-e0fb-4e1f-9bec-eaef67e1699c', '0c6c2d00-ffd4-462a-9cd6-616aca7ca798', 'c56a6b7e-f317-4f00-aed0-bd2f5f282551'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:45 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.info" returned: 0 in 0.507s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:45 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.info is being set with open permissions: ugo+rw
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:45 devstack sudo[99017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.info
Nov 05 03:53:45 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:45 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:53:45 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:45 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.info" returned: 0 in 0.376s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.689s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c1af5268-bc7b-48e4-bd5c-e1b5b85c79b3 tempest-VolumeDependencyTests-784627332 None] Create snapshot completed successfully
Nov 05 03:53:45 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.525s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Deleted volume successfully.
Nov 05 03:53:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4a12fab3-d482-4554-9fb3-cc6da786fa68 tempest-VolumesTransfersV355Test-1611482145 None] Lock "cinder-6cf076cc-f795-453f-a4d0-3f4b08c16cc3-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92f8845e-19b0-472c-a758-98ed271ba538 tempest-VolumesActionsTest-868452643 None] Acquiring lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b" by "attach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92f8845e-19b0-472c-a758-98ed271ba538 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b" acquired by "attach_volume" :: waited 0.055s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Flow 'volume_create_manager' (fbf437d0-2abb-4438-893f-90bcf2340ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc4eda-a774-4303-907c-df31601b9af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc4eda-a774-4303-907c-df31601b9af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-690725180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0f2134-818c-4db9-ae74-60e3df844d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd960de61384d14803ffd41bd691181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ae398428-9cd5-4667-8f08-d4f85579db3f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:47Z,use_quota=True,user_id='355fcbbe88734a9b8181e9d24b09556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be319afe-a0d1-4f71-864a-f456f2989f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be319afe-a0d1-4f71-864a-f456f2989f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a63b761-475a-4df9-829f-73df6cc6bdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a63b761-475a-4df9-829f-73df6cc6bdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f0f2134-818c-4db9-ae74-60e3df844d5c', 'volume_name': 'volume-2f0f2134-818c-4db9-ae74-60e3df844d5c', 'volume_size': 1, 'snapshot_id': 'ae398428-9cd5-4667-8f08-d4f85579db3f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6679d3fa-4d8a-42a9-a75c-1400990569fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6679d3fa-4d8a-42a9-a75c-1400990569fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbafcb8f-50c9-45d1-9710-4bd208679105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Volume 2f0f2134-818c-4db9-ae74-60e3df844d5c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f0f2134-818c-4db9-ae74-60e3df844d5c', 'volume_size': 1, 'snapshot_id': 'ae398428-9cd5-4667-8f08-d4f85579db3f'}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-quobyte-ae398428-9cd5-4667-8f08-d4f85579db3f-2f0f2134-818c-4db9-ae74-60e3df844d5c" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-ae398428-9cd5-4667-8f08-d4f85579db3f-2f0f2134-818c-4db9-ae74-60e3df844d5c" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Creating volume 2f0f2134-818c-4db9-ae74-60e3df844d5c from snapshot ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-quobyte-2f0f2134-818c-4db9-ae74-60e3df844d5c" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-92f8845e-19b0-472c-a758-98ed271ba538 tempest-VolumesActionsTest-868452643 None] Attaching volume 1b57e575-c942-40a2-86ac-e5eb02e5756b to instance 896ddcf3-959f-4b1e-8deb-0829850a1fe6 at mountpoint /dev/vdb on host None.
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2f0f2134-818c-4db9-ae74-60e3df844d5c" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] snapshot: ae398428-9cd5-4667-8f08-d4f85579db3f, volume: 2f0f2134-818c-4db9-ae74-60e3df844d5c,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-92f8845e-19b0-472c-a758-98ed271ba538 tempest-VolumesActionsTest-868452643 None] Attach volume completed successfully.
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb078cd-ebd6-4250-9ada-6dec4b1d328b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92f8845e-19b0-472c-a758-98ed271ba538 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b" released by "attach_volume" :: held 0.582s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:48 devstack sudo[99035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f
Nov 05 03:53:48 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:48 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f" returned: 0 in 0.937s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:53:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a07fc16-3e47-42a7-a898-e75b6064dda0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:49 devstack sudo[99040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4
Nov 05 03:53:49 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f8ed8e78-6045-47d5-8b48-03e39810df22 tempest-VolumesActionsTest-868452643 None] Acquiring lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f8ed8e78-6045-47d5-8b48-03e39810df22 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f8ed8e78-6045-47d5-8b48-03e39810df22 tempest-VolumesActionsTest-868452643 None] Detaching volume 1b57e575-c942-40a2-86ac-e5eb02e5756b from instance 896ddcf3-959f-4b1e-8deb-0829850a1fe6.
Nov 05 03:53:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f8ed8e78-6045-47d5-8b48-03e39810df22 tempest-VolumesActionsTest-868452643 None] Detach volume completed successfully.
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f8ed8e78-6045-47d5-8b48-03e39810df22 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:49 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" returned: 0 in 0.807s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:53:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:49 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c
Nov 05 03:53:49 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:59 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c" returned: 0 in 9.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4, size 1024.00 MB, duration 9.37 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:53:59 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Converted 1024.00 MB image at 109.27 MB/s
Nov 05 03:53:59 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c is being set with open permissions: ugo+rw
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:59 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c
Nov 05 03:53:59 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=27,cinder:DELETE=3,cinder:SELECT=26,cinder:INSERT=7 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=70,cinder:UPDATE=69,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:53:59 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2f0f2134-818c-4db9-ae74-60e3df844d5c" released by "_copy_volume_from_snapshot" :: held 11.735s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-ae398428-9cd5-4667-8f08-d4f85579db3f-2f0f2134-818c-4db9-ae74-60e3df844d5c" released by "_create_volume_from_snapshot" :: held 11.861s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.902s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbafcb8f-50c9-45d1-9710-4bd208679105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0f2134-818c-4db9-ae74-60e3df844d5c', 'volume_size': 1, 'snapshot_id': 'ae398428-9cd5-4667-8f08-d4f85579db3f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8dca1a-6f3a-4f63-a245-5fa45d589190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Volume volume-2f0f2134-818c-4db9-ae74-60e3df844d5c (2f0f2134-818c-4db9-ae74-60e3df844d5c): created successfully
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8dca1a-6f3a-4f63-a245-5fa45d589190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Flow 'volume_create_manager' (fbf437d0-2abb-4438-893f-90bcf2340ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-41072303-19ed-4030-add9-a332b64552b2 tempest-VolumeDependencyTests-784627332 None] Created volume successfully.
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca92760e-d531-48ce-967e-f8df9ee225d3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:59 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:53:59 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:00 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.517s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e91e24-5640-48cc-8d4c-43d256f2fb1d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:00 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:54:00 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-ae398428-9cd5-4667-8f08-d4f85579db3f-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-ae398428-9cd5-4667-8f08-d4f85579db3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-quobyte-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-quobyte-ae398428-9cd5-4667-8f08-d4f85579db3f" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-ae398428-9cd5-4667-8f08-d4f85579db3f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Deleting offline snapshot ae398428-9cd5-4667-8f08-d4f85579db3f of volume 2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] snapshot_file for this snap is: volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c44c84-d659-4fb9-ae69-bb1ecce09b89]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:00 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f
Nov 05 03:54:00 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:00 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.528s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.b1e06cc0-11c3-4166-bf1e-a1e114aaa500mtkaes8r.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:00 devstack sudo[99098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.b1e06cc0-11c3-4166-bf1e-a1e114aaa500mtkaes8r.img
Nov 05 03:54:00 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:01 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f" returned: 0 in 0.541s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b239662f-2d56-4ed6-ac57-7f80c659ba41]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:01 devstack sudo[99106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4
Nov 05 03:54:01 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Flow 'volume_create_manager' (109d843b-c52b-4922-82f4-dd0d4c18589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bec73d-c778-4f05-a749-a180c283e92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bec73d-c778-4f05-a749-a180c283e92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2120574497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618a8aef-ada2-4400-994a-186e1d409820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654635dc9d984407a29292cf4a847a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:01Z,use_quota=True,user_id='eafbbca9cb5e4436a77b2fb1f3c28999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6325f181-146b-4264-8d0d-8608813f98de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6325f181-146b-4264-8d0d-8608813f98de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d202c939-df70-4c24-9401-486e44d1cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d202c939-df70-4c24-9401-486e44d1cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618a8aef-ada2-4400-994a-186e1d409820', 'volume_name': 'volume-618a8aef-ada2-4400-994a-186e1d409820', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc086aa-1ea3-406c-991c-c91299c515f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc086aa-1ea3-406c-991c-c91299c515f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487addcd-6e6b-4322-a2e5-2dec63888d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Volume 618a8aef-ada2-4400-994a-186e1d409820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618a8aef-ada2-4400-994a-186e1d409820', 'volume_size': 1}
Nov 05 03:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:02 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" returned: 0 in 1.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:02 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f
Nov 05 03:54:02 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:03 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f" returned: 0 in 0.864s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:03 devstack sudo[99124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f
Nov 05 03:54:03 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:04 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4.ae398428-9cd5-4667-8f08-d4f85579db3f" returned: 0 in 0.613s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-ae398428-9cd5-4667-8f08-d4f85579db3f" released by "_delete_snapshot" :: held 3.591s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" released by "delete_snapshot" :: held 3.632s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Created reservations ['5107b10c-902d-42b8-b77d-d91ba039a374', '941a6973-4bc4-4c2d-befa-a36f808fce05', '93915c53-9c77-48ce-9b6f-bb679e9a38a7', '48f62078-32d8-458b-a9ec-9cf6390e72db'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Delete snapshot completed successfully.
Nov 05 03:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1fcd64b-89dc-4733-b627-e8c336ecaac8 tempest-VolumeDependencyTests-784627332 None] Lock "cinder-ae398428-9cd5-4667-8f08-d4f85579db3f-delete_snapshot" released by "delete_snapshot" :: held 4.033s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Lock "cinder-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-quobyte-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" acquired by "delete_volume" :: waited 0.050s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3435436a-13f6-4aca-bad1-eb6b46054370]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:05 devstack sudo[99128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4
Nov 05 03:54:05 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:06 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" returned: 0 in 0.667s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:06 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4
Nov 05 03:54:06 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:06 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" returned: 0 in 0.548s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4" released by "delete_volume" :: held 1.383s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Created reservations ['4c8c507b-2469-42d5-bfe2-99d1b243a0f8', '3123b857-7585-4b85-94c6-04e8e22309a3', '6dbac833-8e4d-4ec9-927f-f4f967d3d2ae', '32a58f9f-a6ed-4949-a250-7c88af1a2088'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:07 devstack sudo[99136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:54:07 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:07 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.533s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Deleted volume successfully.
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d79415da-4171-4863-9fa3-c062b6ad3a0d tempest-VolumeDependencyTests-784627332 None] Lock "cinder-2056c6ea-bc5b-4b83-9f85-fd74037ec4d4-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-2f0f2134-818c-4db9-ae74-60e3df844d5c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Lock "cinder-2f0f2134-818c-4db9-ae74-60e3df844d5c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Acquiring lock "cinder-quobyte-2f0f2134-818c-4db9-ae74-60e3df844d5c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2f0f2134-818c-4db9-ae74-60e3df844d5c" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce04de08-16c2-4f14-8ee1-38b784a72170]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:08 devstack sudo[99139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c
Nov 05 03:54:08 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:08 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c" returned: 0 in 0.701s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:08 devstack sudo[99144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c
Nov 05 03:54:08 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:09 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2f0f2134-818c-4db9-ae74-60e3df844d5c" returned: 0 in 0.660s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Lock "cinder-quobyte-2f0f2134-818c-4db9-ae74-60e3df844d5c" released by "delete_volume" :: held 1.459s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Created reservations ['9f3a0a39-23bf-4a58-bcaa-a6f62e61b7f7', '380c7f52-4e8e-47ac-9838-8f49de39d0bc', 'a6e1ca63-c0a9-4114-933f-2df2185e6a17', '19c8eb15-a9bd-41dd-8dc1-1c49ce733161'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:09 devstack sudo[99148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:54:09 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:09 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.b1e06cc0-11c3-4166-bf1e-a1e114aaa500mtkaes8r.img" returned: 0 in 9.025s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2203de-8e7a-433d-acae-f3f2215349ab]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:09 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:54:09 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:10 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Deleted volume successfully.
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d34f5030-8056-4afc-929e-b27e89f106ec tempest-VolumeDependencyTests-784627332 None] Lock "cinder-2f0f2134-818c-4db9-ae74-60e3df844d5c-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:10 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.618s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b, size 1024.00 MB, duration 9.03 sec, destination /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.b1e06cc0-11c3-4166-bf1e-a1e114aaa500mtkaes8r.img {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:54:10 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Converted 1024.00 MB image at 113.44 MB/s
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] b1e06cc0-11c3-4166-bf1e-a1e114aaa500 was raw, no need to convert to raw {{(pid=87401) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:10 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:54:10 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:10 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:54:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Flow 'volume_create_manager' (28dc739b-483c-4907-93bc-aa4aa1d6a8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141e2168-a4df-4132-b267-e3f2a512f1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141e2168-a4df-4132-b267-e3f2a512f1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1715461853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fb4e7e-32d5-49cf-9111-45f2638f776e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3311ea0909486e9a7c7a0488fc5d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:14Z,use_quota=True,user_id='89c904873878425882bf9bc4947abed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657170f6-6b0b-4787-b6ba-9c4bee828461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657170f6-6b0b-4787-b6ba-9c4bee828461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efba9ce4-fd64-43f4-9a6d-5b66da1e079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efba9ce4-fd64-43f4-9a6d-5b66da1e079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1fb4e7e-32d5-49cf-9111-45f2638f776e', 'volume_name': 'volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c9751b-3b58-4f7e-8baf-e43b9fecb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c9751b-3b58-4f7e-8baf-e43b9fecb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd33f43-6482-472d-8d53-d7052d3367d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:13 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Volume e1fb4e7e-32d5-49cf-9111-45f2638f776e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e', 'volume_size': 1}
Nov 05 03:54:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:23 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:54:23 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=24,cinder:SELECT=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.824s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Uploaded volume to glance image-id: b1e06cc0-11c3-4166-bf1e-a1e114aaa500. {{(pid=87401) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.683s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2120574497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618a8aef-ada2-4400-994a-186e1d409820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654635dc9d984407a29292cf4a847a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:01Z,use_quota=True,user_id='eafbbca9cb5e4436a77b2fb1f3c28999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Creating volume 618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:54:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-71c2de49-5147-4343-a0de-42d32fdcc4de tempest-VolumesActionsTest-868452643 None] Copy volume to image completed successfully.
Nov 05 03:54:33 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 1073741824
Nov 05 03:54:33 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:33 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 1073741824" returned: 0 in 0.447s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:34 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820
Nov 05 03:54:34 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:34 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.612s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1715461853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fb4e7e-32d5-49cf-9111-45f2638f776e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3311ea0909486e9a7c7a0488fc5d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:14Z,use_quota=True,user_id='89c904873878425882bf9bc4947abed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Creating volume e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:34 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487addcd-6e6b-4322-a2e5-2dec63888d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618a8aef-ada2-4400-994a-186e1d409820', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d0d67a-d795-48d8-b7f3-61582696f970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:34 devstack sudo[99294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e 1073741824
Nov 05 03:54:34 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Volume volume-618a8aef-ada2-4400-994a-186e1d409820 (618a8aef-ada2-4400-994a-186e1d409820): created successfully
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d0d67a-d795-48d8-b7f3-61582696f970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Flow 'volume_create_manager' (109d843b-c52b-4922-82f4-dd0d4c18589d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7d0d308f-5ab4-4fc7-b6a6-cc65862fed22 tempest-VolumesCloneTest-751293844 None] Created volume successfully.
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:34 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e 1073741824" returned: 0 in 0.513s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:34 devstack sudo[99300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e
Nov 05 03:54:34 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:35 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.543s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd33f43-6482-472d-8d53-d7052d3367d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dd63b8-b0e9-49bb-acf6-fc1d3e032852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[72318dc0-e861-4f07-865c-d96643bbc2ed]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Volume volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e (e1fb4e7e-32d5-49cf-9111-45f2638f776e): created successfully
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dd63b8-b0e9-49bb-acf6-fc1d3e032852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Flow 'volume_create_manager' (28dc739b-483c-4907-93bc-aa4aa1d6a8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Flow 'volume_create_manager' (d8052c3e-c199-46dd-8e2b-ef328d099323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c1a4df-7990-4fad-87d8-f271d4ca0bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2c63e5c2-2d8b-4053-ba69-33c94898af2e tempest-TestStampPattern-639214097 None] Created volume successfully.
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c1a4df-7990-4fad-87d8-f271d4ca0bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1263188083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd5f019-9adc-4131-b14e-9afd8689d1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654635dc9d984407a29292cf4a847a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=618a8aef-ada2-4400-994a-186e1d409820,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:35Z,use_quota=True,user_id='eafbbca9cb5e4436a77b2fb1f3c28999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack sudo[99303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:54:35 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318bc761-525c-4092-85eb-00f8cf844fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318bc761-525c-4092-85eb-00f8cf844fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b92f3f-165c-41ea-9da1-aa9cb109daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b92f3f-165c-41ea-9da1-aa9cb109daf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'acd5f019-9adc-4131-b14e-9afd8689d1ef', 'volume_name': 'volume-acd5f019-9adc-4131-b14e-9afd8689d1ef', 'volume_size': 2, 'source_volid': '618a8aef-ada2-4400-994a-186e1d409820', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c048c3fd-1779-4557-b238-79a71aa31937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c048c3fd-1779-4557-b238-79a71aa31937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0482c0e6-e1aa-48ac-b5e2-97e6c1185233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Volume acd5f019-9adc-4131-b14e-9afd8689d1ef: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-acd5f019-9adc-4131-b14e-9afd8689d1ef', 'volume_size': 2, 'source_volid': '618a8aef-ada2-4400-994a-186e1d409820', 'source_volstatus': 'available'}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:35 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[14761418-fbb5-440d-9962-025c4e02671a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:35 devstack sudo[99308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:54:35 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:35 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:35 devstack sudo[99313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img
Nov 05 03:54:36 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:42 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img" returned: 0 in 6.082s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b879ec-03d6-412f-bf1f-97a879439e59]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:42 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:54:42 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:42 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.592s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:54:42 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Converted 1024.00 MB image at 168.33 MB/s
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] 30f65a5b-d279-4cee-8d4a-ae50957bfa71 was raw, converting to qcow2 {{(pid=87401) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ad9a2-2b40-4efb-965a-82e5cd545575]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:42 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img
Nov 05 03:54:42 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:43 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:43 devstack sudo[99372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img
Nov 05 03:54:43 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:43 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img" returned: 1 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img /opt/stack/data/cinder/conversion/vol_upload_c71gv3dh {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:43 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img /opt/stack/data/cinder/conversion/vol_upload_c71gv3dh
Nov 05 03:54:43 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:43 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img /opt/stack/data/cinder/conversion/vol_upload_c71gv3dh" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Image conversion details: src /opt/stack/data/cinder/conversion/1b57e575-c942-40a2-86ac-e5eb02e5756b.temp_image.30f65a5b-d279-4cee-8d4a-ae50957bfa718ylv5212.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_c71gv3dh {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:54:43 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[17266168-17ab-4164-9833-9f09c6a82232]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c71gv3dh {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:43 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c71gv3dh
Nov 05 03:54:43 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:43 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c71gv3dh" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.259s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Uploaded volume to glance image-id: 30f65a5b-d279-4cee-8d4a-ae50957bfa71. {{(pid=87401) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}}
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.032s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:45 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Cloning volume 618a8aef-ada2-4400-994a-186e1d409820 to volume acd5f019-9adc-4131-b14e-9afd8689d1ef
Nov 05 03:54:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-287d5156-2a69-4dc7-9a24-02d0839902c6 tempest-VolumesActionsTest-868452643 None] Copy volume to image completed successfully.
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Creating offline snapshot c4746ddd-f737-4cb0-9921-8e9d23623f7f of volume 618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[702cb7f3-a859-4332-9f49-91f9ee3c5347]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:45 devstack sudo[99391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820
Nov 05 03:54:45 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:45 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:45 devstack sudo[99399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f 1G
Nov 05 03:54:45 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:46 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f 1G" returned: 0 in 0.573s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618a8aef-ada2-4400-994a-186e1d409820 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:46 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618a8aef-ada2-4400-994a-186e1d409820 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f
Nov 05 03:54:46 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-28df1fe3-7913-4b17-ad72-f3a8dcd1a485 req-64188a64-b925-46af-938b-716141de9748 tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:46 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618a8aef-ada2-4400-994a-186e1d409820 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:46 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f is being set with open permissions: ugo+rw
Nov 05 03:54:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:46 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f
Nov 05 03:54:46 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Acquiring lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Acquiring lock "cinder-quobyte-1b57e575-c942-40a2-86ac-e5eb02e5756b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Lock "cinder-quobyte-1b57e575-c942-40a2-86ac-e5eb02e5756b" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[994da0d5-d51f-4070-8a8c-d32f5830f789]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:47 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f" returned: 0 in 0.318s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:47 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:54:47 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:47 devstack sudo[99422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.info
Nov 05 03:54:47 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:47 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.info" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:47 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.info is being set with open permissions: ugo+rw
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:47 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:47 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.info
Nov 05 03:54:47 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:47 devstack sudo[99429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b
Nov 05 03:54:47 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:47 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-1b57e575-c942-40a2-86ac-e5eb02e5756b" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:47 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.info" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Acquiring lock "cinder-quobyte-acd5f019-9adc-4131-b14e-9afd8689d1ef" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Lock "cinder-quobyte-1b57e575-c942-40a2-86ac-e5eb02e5756b" released by "delete_volume" :: held 0.770s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-acd5f019-9adc-4131-b14e-9afd8689d1ef" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] snapshot: c4746ddd-f737-4cb0-9921-8e9d23623f7f, volume: acd5f019-9adc-4131-b14e-9afd8689d1ef,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df3d78-9cf2-4856-9432-61bcac2a1b6e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Created reservations ['89d1f7a5-8aef-4c6a-b453-c394eec1d6b5', '5c5d4ee5-2306-453b-af31-cd28eeec2999', '49be9a27-3dff-4853-bf00-30c65776a5e8', '657c4496-6f98-4d0d-9b06-e87acef36093'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:48 devstack sudo[99434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f
Nov 05 03:54:48 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:48 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:54:48 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:48 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Deleted volume successfully.
Nov 05 03:54:48 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f" returned: 0 in 0.511s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-618a8aef-ada2-4400-994a-186e1d409820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-279c09bc-09b8-4641-a8bd-c215d71cd618 tempest-VolumesActionsTest-868452643 None] Lock "cinder-1b57e575-c942-40a2-86ac-e5eb02e5756b-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2017e2b-eaca-4936-afac-29cf8745eaef]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:48 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820
Nov 05 03:54:48 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:48 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:54:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:48 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef
Nov 05 03:54:48 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:55 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef" returned: 0 in 7.038s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:55 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:54:55 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Converted 1024.00 MB image at 145.46 MB/s
Nov 05 03:54:55 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef is being set with open permissions: ugo+rw
Nov 05 03:54:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:55 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef
Nov 05 03:54:55 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:56 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-acd5f019-9adc-4131-b14e-9afd8689d1ef" released by "_copy_volume_from_snapshot" :: held 8.337s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Acquiring lock "cinder-quobyte-c4746ddd-f737-4cb0-9921-8e9d23623f7f" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-c4746ddd-f737-4cb0-9921-8e9d23623f7f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Deleting offline snapshot c4746ddd-f737-4cb0-9921-8e9d23623f7f of volume 618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] snapshot_file for this snap is: volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c474a8-8607-42a0-975d-4e804b5bd9d6]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:56 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f
Nov 05 03:54:56 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:56 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-618a8aef-ada2-4400-994a-186e1d409820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6615f795-3d51-4f6c-a3ff-cd2f34487c1d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:56 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820
Nov 05 03:54:56 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:57 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820" returned: 0 in 0.592s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:57 devstack sudo[99488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f
Nov 05 03:54:57 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:57 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:57 devstack sudo[99493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f
Nov 05 03:54:57 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:54:58 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820.c4746ddd-f737-4cb0-9921-8e9d23623f7f" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-c4746ddd-f737-4cb0-9921-8e9d23623f7f" released by "_delete_snapshot" :: held 1.840s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.695s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-28df1fe3-7913-4b17-ad72-f3a8dcd1a485 req-64188a64-b925-46af-938b-716141de9748 tempest-TestStampPattern-639214097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.442s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-28df1fe3-7913-4b17-ad72-f3a8dcd1a485 req-64188a64-b925-46af-938b-716141de9748 tempest-TestStampPattern-639214097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0482c0e6-e1aa-48ac-b5e2-97e6c1185233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd5f019-9adc-4131-b14e-9afd8689d1ef', 'volume_size': 2, 'source_volid': '618a8aef-ada2-4400-994a-186e1d409820', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7d91d0-ba72-4348-8ff5-2df2330c3f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Volume volume-acd5f019-9adc-4131-b14e-9afd8689d1ef (acd5f019-9adc-4131-b14e-9afd8689d1ef): created successfully
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7d91d0-ba72-4348-8ff5-2df2330c3f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Flow 'volume_create_manager' (d8052c3e-c199-46dd-8e2b-ef328d099323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-28df1fe3-7913-4b17-ad72-f3a8dcd1a485 req-64188a64-b925-46af-938b-716141de9748 tempest-TestStampPattern-639214097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd34287b-3b7f-4d33-b75c-64d2f3a0d572', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:54:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4dbb416d-f1d6-4f7a-a97b-6162f5d4d066 tempest-VolumesCloneTest-751293844 None] Created volume successfully.
Nov 05 03:54:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-28df1fe3-7913-4b17-ad72-f3a8dcd1a485 req-64188a64-b925-46af-938b-716141de9748 tempest-TestStampPattern-639214097 None] attachment_update completed successfully.
Nov 05 03:54:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Acquiring lock "cinder-acd5f019-9adc-4131-b14e-9afd8689d1ef-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Lock "cinder-acd5f019-9adc-4131-b14e-9afd8689d1ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Acquiring lock "cinder-quobyte-acd5f019-9adc-4131-b14e-9afd8689d1ef" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-acd5f019-9adc-4131-b14e-9afd8689d1ef" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8973c607-d283-4447-a7a9-136852b9f6d2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:59 devstack sudo[99915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef
Nov 05 03:54:59 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:00 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:00 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef
Nov 05 03:55:00 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:00 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-acd5f019-9adc-4131-b14e-9afd8689d1ef" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-acd5f019-9adc-4131-b14e-9afd8689d1ef" released by "delete_volume" :: held 0.733s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Created reservations ['060efc8e-4acb-42b0-b648-300e74537e13', '960304be-2763-4c0a-a41e-b11e48c76eb1', '843b3567-9631-49a3-837e-3a8a652cf368', '8f88eda8-ac00-437a-920c-ef30ff8a6088'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:00 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:00 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Acquiring lock "cinder-618a8aef-ada2-4400-994a-186e1d409820-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:01 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Lock "cinder-618a8aef-ada2-4400-994a-186e1d409820-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Deleted volume successfully.
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e09d16e5-f240-4052-9346-bb7d100191b8 tempest-VolumesCloneTest-751293844 None] Lock "cinder-acd5f019-9adc-4131-b14e-9afd8689d1ef-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Acquiring lock "cinder-quobyte-618a8aef-ada2-4400-994a-186e1d409820" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-618a8aef-ada2-4400-994a-186e1d409820" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f5b2a8-997e-48a7-b8ed-d86f73f270fa]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:01 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820
Nov 05 03:55:01 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:01 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:01 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820
Nov 05 03:55:01 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:01 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-618a8aef-ada2-4400-994a-186e1d409820" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Lock "cinder-quobyte-618a8aef-ada2-4400-994a-186e1d409820" released by "delete_volume" :: held 0.764s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:01 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Created reservations ['90b06dd2-88eb-46c2-a42b-b5fa01a62626', 'db94e84b-22ca-45e0-9abc-63b05f327888', 'ee1d842b-f3eb-4c17-84e3-34a591e3bf13', 'cc8d5919-db84-467a-a48e-e549d4253852'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:02 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:02 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:02 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.459s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Deleted volume successfully.
Nov 05 03:55:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-938e31c0-a0f0-4de0-a0de-4c585957a857 tempest-VolumesCloneTest-751293844 None] Lock "cinder-618a8aef-ada2-4400-994a-186e1d409820-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-fed4c033-a47e-4047-9768-4769852c8435 req-cfaf89a2-15b0-4e4e-a43a-d9bae060e452 tempest-TestStampPattern-639214097 None] Terminate volume connection completed successfully.
Nov 05 03:55:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-fed4c033-a47e-4047-9768-4769852c8435 req-cfaf89a2-15b0-4e4e-a43a-d9bae060e452 tempest-TestStampPattern-639214097 None] Deleting attachment fd34287b-3b7f-4d33-b75c-64d2f3a0d572. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:55:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Creating offline snapshot 5a5a7896-aac3-4aa8-8a2c-79f877cf654f of volume e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b02244-52bc-4d42-8582-6459702116a2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:05 devstack sudo[100316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e
Nov 05 03:55:05 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:05 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e" returned: 0 in 0.530s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:05 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f 1G
Nov 05 03:55:05 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:06 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f 1G" returned: 0 in 0.657s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:06 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f
Nov 05 03:55:06 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:06 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:06 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f is being set with open permissions: ugo+rw
Nov 05 03:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:07 devstack sudo[100334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f
Nov 05 03:55:07 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:07 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f" returned: 0 in 0.384s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:07 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.info
Nov 05 03:55:07 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:07 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.info" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:07 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.info is being set with open permissions: ugo+rw
Nov 05 03:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:07 devstack sudo[100340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.info
Nov 05 03:55:07 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:08 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.info" returned: 0 in 0.396s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b1af7065-aa13-4593-9394-369606252fd0 tempest-TestStampPattern-639214097 None] Create snapshot completed successfully
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Flow 'volume_create_manager' (1747e44e-ea29-4efa-a854-8ae0d0857805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cc2766-a41a-49dd-b7ab-5937550100ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cc2766-a41a-49dd-b7ab-5937550100ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1006326434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e6f58e-8787-4153-b9a9-b4d3c0843b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b847883bca6f41b99276743152405e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:08Z,use_quota=True,user_id='d3d2d5251e1b4b439a482cabd57397ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488f096a-c0c6-49f4-ac2f-f5dac84cad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488f096a-c0c6-49f4-ac2f-f5dac84cad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9691c4d7-3a5a-4f7d-938a-dcc7cfd08751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9691c4d7-3a5a-4f7d-938a-dcc7cfd08751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e6f58e-8787-4153-b9a9-b4d3c0843b9b', 'volume_name': 'volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654f3a47-78fc-4e56-a916-c0c89905e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654f3a47-78fc-4e56-a916-c0c89905e58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37b3dd-8517-4936-965a-3bba86182339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Volume 15e6f58e-8787-4153-b9a9-b4d3c0843b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b', 'volume_size': 2}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1006326434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e6f58e-8787-4153-b9a9-b4d3c0843b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b847883bca6f41b99276743152405e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:08Z,use_quota=True,user_id='d3d2d5251e1b4b439a482cabd57397ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Creating volume 15e6f58e-8787-4153-b9a9-b4d3c0843b9b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:08 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b 2147483648 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:08 devstack sudo[100343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b 2147483648
Nov 05 03:55:08 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:09 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b 2147483648" returned: 0 in 0.850s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:09 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b
Nov 05 03:55:09 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:09 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37b3dd-8517-4936-965a-3bba86182339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec16bb46-ca64-460f-9ead-399179522eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Volume volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b (15e6f58e-8787-4153-b9a9-b4d3c0843b9b): created successfully
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec16bb46-ca64-460f-9ead-399179522eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Flow 'volume_create_manager' (1747e44e-ea29-4efa-a854-8ae0d0857805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-be9056c8-9613-4dc4-ba39-415142d0bd7c tempest-VolumesCloneNegativeTest-407181797 None] Created volume successfully.
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (dd5446a7-1783-4783-a1b5-d7ff4907137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2847149d-cf44-4fd0-b6e9-d5047eb8bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2847149d-cf44-4fd0-b6e9-d5047eb8bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-184142199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eafcab1-dcbb-49d2-85eb-57fbb6831522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:10Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907d2ed-19fe-409a-a463-e41232943cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907d2ed-19fe-409a-a463-e41232943cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4377fb4-590f-4e53-9a22-61e228f874db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4377fb4-590f-4e53-9a22-61e228f874db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eafcab1-dcbb-49d2-85eb-57fbb6831522', 'volume_name': 'volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48dbd270-0c25-47ce-8132-5c367fb8e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48dbd270-0c25-47ce-8132-5c367fb8e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7edc2c-3457-4706-8e55-f68c380d6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Volume 5eafcab1-dcbb-49d2-85eb-57fbb6831522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522', 'volume_size': 1}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-184142199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eafcab1-dcbb-49d2-85eb-57fbb6831522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:10Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Creating volume 5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:10 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:10 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 1073741824
Nov 05 03:55:10 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:10 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:10 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Acquiring lock "cinder-15e6f58e-8787-4153-b9a9-b4d3c0843b9b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Lock "cinder-15e6f58e-8787-4153-b9a9-b4d3c0843b9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:10 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 1073741824" returned: 0 in 0.582s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Acquiring lock "cinder-quobyte-15e6f58e-8787-4153-b9a9-b4d3c0843b9b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Lock "cinder-quobyte-15e6f58e-8787-4153-b9a9-b4d3c0843b9b" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4988c694-e9cd-4e09-8849-9e5f500b2647]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:11 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522
Nov 05 03:55:11 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:11 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.412s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:55:11 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b
Nov 05 03:55:11 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:11 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7edc2c-3457-4706-8e55-f68c380d6601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8760011-ac95-4a3f-8e9b-ac08fb281d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:11 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Volume volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 (5eafcab1-dcbb-49d2-85eb-57fbb6831522): created successfully
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8760011-ac95-4a3f-8e9b-ac08fb281d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (dd5446a7-1783-4783-a1b5-d7ff4907137e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4412bbea-f2e5-4e59-8d4f-feb2fca3500e tempest-VolumesSnapshotTestJSON-1124376948 None] Created volume successfully.
Nov 05 03:55:11 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b" returned: 0 in 0.510s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:11 devstack sudo[100477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b
Nov 05 03:55:11 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:11 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-15e6f58e-8787-4153-b9a9-b4d3c0843b9b" returned: 0 in 0.254s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Lock "cinder-quobyte-15e6f58e-8787-4153-b9a9-b4d3c0843b9b" released by "delete_volume" :: held 0.844s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Created reservations ['75bc1d30-f0cc-4842-afef-b7ba3aa90a14', '70231d1e-e6b8-4f52-add8-1886b0c33498', '16e3b47e-730c-428e-8cd9-51acd8c8449e', 'fdb55ac7-edc3-4e4b-bd0b-9068f6652a79'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:12 devstack sudo[100488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:12 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:12 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:12 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Deleted volume successfully.
Nov 05 03:55:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ffa89dd-d447-461a-b418-acd83e7d2705 tempest-VolumesCloneNegativeTest-407181797 None] Lock "cinder-15e6f58e-8787-4153-b9a9-b4d3c0843b9b-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Creating offline snapshot f9b2c88c-5931-4302-877d-9cc1f79c456c of volume 5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f97e8f-2c71-45bf-9cc8-0ece2eeb2304]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:13 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522
Nov 05 03:55:13 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:13 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522" returned: 0 in 0.519s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:13 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c 1G
Nov 05 03:55:13 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:14 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c 1G" returned: 0 in 0.513s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:14 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c
Nov 05 03:55:14 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:14 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c is being set with open permissions: ugo+rw
Nov 05 03:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:14 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c
Nov 05 03:55:14 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:14 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c" returned: 0 in 0.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:14 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.info
Nov 05 03:55:14 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:15 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.info" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:15 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.info is being set with open permissions: ugo+rw
Nov 05 03:55:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:15 devstack sudo[100513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.info
Nov 05 03:55:15 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:15 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.info" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-31137db7-8213-4dde-be20-83a2fd5e2bb2 tempest-VolumesSnapshotTestJSON-1124376948 None] Create snapshot completed successfully
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-f9b2c88c-5931-4302-877d-9cc1f79c456c-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-f9b2c88c-5931-4302-877d-9cc1f79c456c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-5eafcab1-dcbb-49d2-85eb-57fbb6831522" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-5eafcab1-dcbb-49d2-85eb-57fbb6831522" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-f9b2c88c-5931-4302-877d-9cc1f79c456c" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-f9b2c88c-5931-4302-877d-9cc1f79c456c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Deleting offline snapshot f9b2c88c-5931-4302-877d-9cc1f79c456c of volume 5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] snapshot_file for this snap is: volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1e910f-4923-42d8-a0d6-dbbc3774ba81]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Flow 'volume_create_manager' (357439e7-6c71-4367-aefb-ca80e6a80689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa42e5c3-7e8e-44fb-8355-f32cf229c821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa42e5c3-7e8e-44fb-8355-f32cf229c821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1492857705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d429cc1-ccef-46dd-b8e9-e5f4cfc01565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1f427aef5547d89d8ce4b70a1c85d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:17Z,use_quota=True,user_id='3b7d1d3ceed748118eb98bab2b2c448e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b2d84c-2b43-46c9-908a-bbb5d556fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b2d84c-2b43-46c9-908a-bbb5d556fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa8ac07-cf23-4eb9-9f3e-8e88e36d1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:16 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:55:16 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c
Nov 05 03:55:16 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Flow 'volume_create_manager' (259420e1-dbc0-4967-b940-3242439f7b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81babe95-b63e-4546-86f7-8c636a32f40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81babe95-b63e-4546-86f7-8c636a32f40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-904052623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3311ea0909486e9a7c7a0488fc5d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a5a7896-aac3-4aa8-8a2c-79f877cf654f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:17Z,use_quota=True,user_id='89c904873878425882bf9bc4947abed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3895ed49-fa2e-4ee3-8f5e-d15c27e8dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3895ed49-fa2e-4ee3-8f5e-d15c27e8dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23669518-a5ea-4928-9ae3-0b96d63dcdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23669518-a5ea-4928-9ae3-0b96d63dcdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490', 'volume_name': 'volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490', 'volume_size': 1, 'snapshot_id': '5a5a7896-aac3-4aa8-8a2c-79f877cf654f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf9d582-8e8a-4695-ada2-936b2d3149fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf9d582-8e8a-4695-ada2-936b2d3149fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d67e3-7c32-4d3f-93c6-0f1d839ef717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Volume c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490', 'volume_size': 1, 'snapshot_id': '5a5a7896-aac3-4aa8-8a2c-79f877cf654f'}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-quobyte-5a5a7896-aac3-4aa8-8a2c-79f877cf654f-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-5a5a7896-aac3-4aa8-8a2c-79f877cf654f-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Creating volume c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 from snapshot 5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-quobyte-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] snapshot: 5a5a7896-aac3-4aa8-8a2c-79f877cf654f, volume: c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa002cb4-ec82-4e94-a2cc-973677f1336d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa8ac07-cf23-4eb9-9f3e-8e88e36d1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d429cc1-ccef-46dd-b8e9-e5f4cfc01565', 'volume_name': 'volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab53a45c0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c895c301-5411-4da6-97d6-5144cc28d2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c895c301-5411-4da6-97d6-5144cc28d2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144eb093-a85b-4a17-a2df-9fdf56f36056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Volume 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab53a45c0>}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Trying to clone 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 from image be17f312-5d93-463e-be81-a5040fe456d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:55:17 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c" returned: 0 in 0.553s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd43eeff-d877-4869-8468-5e0bc1f54df1]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:17 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f
Nov 05 03:55:17 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:17 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522
Nov 05 03:55:17 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:17 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:55:17 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa1fa4-6058-498c-b857-5289fc95e951]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5a1aa-6dc5-4eb2-85eb-33fa2d1fd72f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:17 devstack sudo[100530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e
Nov 05 03:55:17 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:17 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522" returned: 0 in 0.563s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:18 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD
Nov 05 03:55:18 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:18 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c
Nov 05 03:55:18 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:18 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 is fetched for user 3b7d1d3ceed748118eb98bab2b2c448e. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:55:18 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:18 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[97985310-9f48-47cd-abf9-9bb00df49618]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:18 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:18 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:18 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c
Nov 05 03:55:18 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:18 devstack sudo[100552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD
Nov 05 03:55:18 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:18 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522.f9b2c88c-5931-4302-877d-9cc1f79c456c" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:18 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-f9b2c88c-5931-4302-877d-9cc1f79c456c" released by "_delete_snapshot" :: held 2.091s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-5eafcab1-dcbb-49d2-85eb-57fbb6831522" released by "delete_snapshot" :: held 2.126s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['41f8aa46-499a-4ba1-bce8-ce3985193b4f', 'da4437a7-8a2f-4de6-9c6f-dd6d995c8b07', 'f9dd08c6-4729-4e85-a307-f9ce83f27ac5', '60401ab7-bbab-44d2-a02f-5493c6096062'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Delete snapshot completed successfully.
Nov 05 03:55:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bfb5055-45f8-4ae6-94e4-fc46256e935e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-f9b2c88c-5931-4302-877d-9cc1f79c456c-delete_snapshot" released by "delete_snapshot" :: held 2.404s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (82565c86-bd00-4a2b-84e0-252497149e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7351324-3cac-4b77-9f46-9fcab793514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7351324-3cac-4b77-9f46-9fcab793514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1144762120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db0f06-2736-46d8-846a-863ca10240be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:21Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dffa962-51da-4452-9e8a-b87099781f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dffa962-51da-4452-9e8a-b87099781f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed901db-24ee-482e-a3b2-d84ca4f79ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed901db-24ee-482e-a3b2-d84ca4f79ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91db0f06-2736-46d8-846a-863ca10240be', 'volume_name': 'volume-91db0f06-2736-46d8-846a-863ca10240be', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47840b4-2264-427b-9598-588fabd7c78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47840b4-2264-427b-9598-588fabd7c78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41e700d-a741-492e-9a53-94a004dc7aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Volume 91db0f06-2736-46d8-846a-863ca10240be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91db0f06-2736-46d8-846a-863ca10240be', 'volume_size': 1}
Nov 05 03:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:27 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" returned: 0 in 9.057s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:55:27 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Converted 1024.00 MB image at 113.05 MB/s
Nov 05 03:55:27 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 is being set with open permissions: ugo+rw
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:27 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490
Nov 05 03:55:27 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:27 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" returned: 0 in 0.396s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" released by "_copy_volume_from_snapshot" :: held 10.577s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=56,cinder:INSERT=21,cinder:SELECT=67,cinder:DELETE=6 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-5a5a7896-aac3-4aa8-8a2c-79f877cf654f-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" released by "_create_volume_from_snapshot" :: held 10.665s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.687s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.996s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1492857705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d429cc1-ccef-46dd-b8e9-e5f4cfc01565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1f427aef5547d89d8ce4b70a1c85d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:17Z,use_quota=True,user_id='3b7d1d3ceed748118eb98bab2b2c448e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Creating volume 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:27 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:27 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 1073741824
Nov 05 03:55:27 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d67e3-7c32-4d3f-93c6-0f1d839ef717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490', 'volume_size': 1, 'snapshot_id': '5a5a7896-aac3-4aa8-8a2c-79f877cf654f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0be828-bcdc-4555-8daf-f831f3a9419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:28 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Volume volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 (c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490): created successfully
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0be828-bcdc-4555-8daf-f831f3a9419c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Flow 'volume_create_manager' (259420e1-dbc0-4967-b940-3242439f7b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-de86c352-0b3c-4e21-82e4-90a1a00ea7e2 tempest-TestStampPattern-639214097 None] Created volume successfully.
Nov 05 03:55:28 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 1073741824" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:28 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565
Nov 05 03:55:28 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:28 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.126s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1144762120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db0f06-2736-46d8-846a-863ca10240be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:21Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Creating volume 91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:28 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:28 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be 1073741824
Nov 05 03:55:28 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Attempting download of be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a415d1-514d-4687-98b7-46c2f2b28513]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_o9ge2i2q {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:29 devstack sudo[100661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_o9ge2i2q
Nov 05 03:55:29 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:29 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_o9ge2i2q" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_o9ge2i2q {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:29 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be 1073741824" returned: 0 in 0.633s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:29 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be
Nov 05 03:55:29 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:29 devstack sudo[100670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_o9ge2i2q
Nov 05 03:55:29 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:29 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:29 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_o9ge2i2q" returned: 1 in 0.376s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be17f312-5d93-463e-be81-a5040fe456d8_o9ge2i2q' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c4fbdc-3aea-4ad8-a073-c87ecccd4e78]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41e700d-a741-492e-9a53-94a004dc7aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91db0f06-2736-46d8-846a-863ca10240be', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ca5195-43e8-4051-bdc9-97d39401ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:29 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Volume volume-91db0f06-2736-46d8-846a-863ca10240be (91db0f06-2736-46d8-846a-863ca10240be): created successfully
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ca5195-43e8-4051-bdc9-97d39401ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (82565c86-bd00-4a2b-84e0-252497149e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a44dcc8d-52c6-4d48-b513-59e10d456e80 tempest-VolumesSnapshotTestJSON-1124376948 None] Created volume successfully.
Nov 05 03:55:29 devstack sudo[100677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD
Nov 05 03:55:29 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:30 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] be17f312-5d93-463e-be81-a5040fe456d8 was qcow2, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:30 devstack sudo[100682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565
Nov 05 03:55:30 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Creating offline snapshot f76eb768-cd38-4e4e-a944-ff8db87755fa of volume 91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[088859e5-0dbe-4a93-b119-84723dbb4633]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:30 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be
Nov 05 03:55:30 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:31 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be" returned: 0 in 0.518s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:31 devstack sudo[100697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa 1G
Nov 05 03:55:31 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:31 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa 1G" returned: 0 in 0.735s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db0f06-2736-46d8-846a-863ca10240be -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:31 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db0f06-2736-46d8-846a-863ca10240be -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa
Nov 05 03:55:31 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:32 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db0f06-2736-46d8-846a-863ca10240be -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa" returned: 0 in 0.466s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:32 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa is being set with open permissions: ugo+rw
Nov 05 03:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:32 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa
Nov 05 03:55:32 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:32 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:32 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.info
Nov 05 03:55:32 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:32 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" returned: 0 in 2.733s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:32 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be17f312-5d93-463e-be81-a5040fe456d8_91eabhardevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:55:32 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Converted 112.00 MB image at 40.95 MB/s
Nov 05 03:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:33 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 1G
Nov 05 03:55:33 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:33 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.info" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:33 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.info is being set with open permissions: ugo+rw
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:33 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.info
Nov 05 03:55:33 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 1G" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Downloaded image be17f312-5d93-463e-be81-a5040fe456d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}])) to volume 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:55:33 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Temporary image be17f312-5d93-463e-be81-a5040fe456d8 for user 3b7d1d3ceed748118eb98bab2b2c448e is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Marking volume 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Copying metadata from image be17f312-5d93-463e-be81-a5040fe456d8 to 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Creating volume glance metadata for volume 2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 backed by image be17f312-5d93-463e-be81-a5040fe456d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:55:33 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.info" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4a62683c-b231-49cd-b48d-8736043ad16d tempest-VolumesSnapshotTestJSON-1124376948 None] Create snapshot completed successfully
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144eb093-a85b-4a17-a2df-9fdf56f36056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565', 'volume_size': 1, 'image_id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be17f312-5d93-463e-be81-a5040fe456d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4e6eaf99f7949e387ae99e83df732cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be17f312-5d93-463e-be81-a5040fe456d8', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be17f312-5d93-463e-be81-a5040fe456d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab53a45c0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f350cf3b-07c0-4ef0-96f3-3d44b4052be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Volume volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 (2d429cc1-ccef-46dd-b8e9-e5f4cfc01565): created successfully
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f350cf3b-07c0-4ef0-96f3-3d44b4052be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Flow 'volume_create_manager' (357439e7-6c71-4367-aefb-ca80e6a80689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b69c2c5a-1104-49bd-963d-2e8377de1760 tempest-VolumesExtendTest-493201748 None] Created volume successfully.
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[accb4eb4-851e-4ccd-81fe-eb95fb21c859]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:34 devstack sudo[100724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565
Nov 05 03:55:34 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:34 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" returned: 0 in 0.581s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 2G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 2G" returned: 0 in 0.116s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.728s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (d7f23f52-5729-4d62-b54e-edfebcb2e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5608c7bc-b1f4-46b3-8cba-946a202cfc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5608c7bc-b1f4-46b3-8cba-946a202cfc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1145573765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cbae40-33f3-479d-ad05-82e75e056816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f76eb768-cd38-4e4e-a944-ff8db87755fa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:35Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5588761-24e3-48cc-9e48-2f1cb2eb0b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5588761-24e3-48cc-9e48-2f1cb2eb0b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9171d661-b669-4dca-9cf1-772776d12fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9171d661-b669-4dca-9cf1-772776d12fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64cbae40-33f3-479d-ad05-82e75e056816', 'volume_name': 'volume-64cbae40-33f3-479d-ad05-82e75e056816', 'volume_size': 2, 'snapshot_id': 'f76eb768-cd38-4e4e-a944-ff8db87755fa'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ba78ac-5e79-4210-a3b4-ccb48db323b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ba78ac-5e79-4210-a3b4-ccb48db323b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588841d4-7331-4f7b-b637-ec4470b8a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Volume 64cbae40-33f3-479d-ad05-82e75e056816: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64cbae40-33f3-479d-ad05-82e75e056816', 'volume_size': 2, 'snapshot_id': 'f76eb768-cd38-4e4e-a944-ff8db87755fa'}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-f76eb768-cd38-4e4e-a944-ff8db87755fa-64cbae40-33f3-479d-ad05-82e75e056816" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-95abc5a1-f50a-4244-ab8c-d7ba024643f6 tempest-VolumesExtendTest-493201748 None] Extend volume completed successfully.
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-f76eb768-cd38-4e4e-a944-ff8db87755fa-64cbae40-33f3-479d-ad05-82e75e056816" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Creating volume 64cbae40-33f3-479d-ad05-82e75e056816 from snapshot f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-64cbae40-33f3-479d-ad05-82e75e056816" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-64cbae40-33f3-479d-ad05-82e75e056816" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] snapshot: f76eb768-cd38-4e4e-a944-ff8db87755fa, volume: 64cbae40-33f3-479d-ad05-82e75e056816,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[390c363e-935b-41cc-9df7-d893b9d70fd1]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:34 devstack sudo[100738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa
Nov 05 03:55:34 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:35 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db0f06-2736-46d8-846a-863ca10240be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[790dd46b-6402-4430-8df3-55cdc56070ed]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:35 devstack sudo[100743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be
Nov 05 03:55:35 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Acquiring lock "cinder-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Lock "cinder-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Acquiring lock "cinder-quobyte-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caf06c1-c48e-47f1-be43-fdb1bdbce055]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:35 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:35 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565
Nov 05 03:55:35 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:35 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816
Nov 05 03:55:35 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:35 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:36 devstack sudo[100758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565
Nov 05 03:55:36 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:36 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565" released by "delete_volume" :: held 0.782s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Created reservations ['b5a5155e-b6b9-45e0-be0c-0a7593b8cb64', '1b9d4383-039e-4d04-8229-24ac892ebc12', '485316ad-58ad-4e68-a4fe-c81a9dcd4052', '8d52d919-76cf-458d-85cd-302a8e8a925e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:36 devstack sudo[100768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:36 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:37 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.595s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Deleted volume successfully.
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b34cbf21-e4c8-4731-855b-ae3370022d52 tempest-VolumesExtendTest-493201748 None] Lock "cinder-2d429cc1-ccef-46dd-b8e9-e5f4cfc01565-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Flow 'volume_create_manager' (a4e1531c-fb58-44f4-a3e2-f2097cd992ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f9fb5a-7bff-4b7f-835f-048f0a1e200d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f9fb5a-7bff-4b7f-835f-048f0a1e200d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-19192992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52c7bb4-ff81-46a4-84de-a6507ce70a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1f427aef5547d89d8ce4b70a1c85d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:38Z,use_quota=True,user_id='3b7d1d3ceed748118eb98bab2b2c448e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8047779-23fa-4b8c-9c16-0687252dfdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8047779-23fa-4b8c-9c16-0687252dfdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf3b5d3-60ef-4c41-b3d7-7c3eb7b3e837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf3b5d3-60ef-4c41-b3d7-7c3eb7b3e837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52c7bb4-ff81-46a4-84de-a6507ce70a63', 'volume_name': 'volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4d8448-200a-4706-9508-d8f8884676c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4d8448-200a-4706-9508-d8f8884676c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ab711a-6aff-43c8-97cd-0213d83bc319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Volume b52c7bb4-ff81-46a4-84de-a6507ce70a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63', 'volume_size': 1}
Nov 05 03:55:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:43 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816" returned: 0 in 7.485s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:55:43 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Converted 1024.00 MB image at 136.80 MB/s
Nov 05 03:55:43 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816 is being set with open permissions: ugo+rw
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:43 devstack sudo[100823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816
Nov 05 03:55:43 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:43 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-64cbae40-33f3-479d-ad05-82e75e056816" released by "_copy_volume_from_snapshot" :: held 8.625s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-f76eb768-cd38-4e4e-a944-ff8db87755fa-64cbae40-33f3-479d-ad05-82e75e056816" released by "_create_volume_from_snapshot" :: held 8.687s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.708s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.478s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-19192992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52c7bb4-ff81-46a4-84de-a6507ce70a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1f427aef5547d89d8ce4b70a1c85d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:38Z,use_quota=True,user_id='3b7d1d3ceed748118eb98bab2b2c448e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Creating volume b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:43 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:43 devstack sudo[100826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 1073741824
Nov 05 03:55:43 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588841d4-7331-4f7b-b637-ec4470b8a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64cbae40-33f3-479d-ad05-82e75e056816', 'volume_size': 2, 'snapshot_id': 'f76eb768-cd38-4e4e-a944-ff8db87755fa'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b17c145-e1b2-416e-8ecc-e12576871d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Volume volume-64cbae40-33f3-479d-ad05-82e75e056816 (64cbae40-33f3-479d-ad05-82e75e056816): created successfully
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b17c145-e1b2-416e-8ecc-e12576871d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (d7f23f52-5729-4d62-b54e-edfebcb2e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0952c079-fb42-48c2-af5d-d39bef0c82ae tempest-VolumesSnapshotTestJSON-1124376948 None] Created volume successfully.
Nov 05 03:55:43 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 1073741824" returned: 0 in 0.427s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:43 devstack sudo[100832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63
Nov 05 03:55:43 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:44 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ab711a-6aff-43c8-97cd-0213d83bc319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b860ad-3b1e-4001-a918-9a82debed192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:44 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Volume volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 (b52c7bb4-ff81-46a4-84de-a6507ce70a63): created successfully
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b860ad-3b1e-4001-a918-9a82debed192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Flow 'volume_create_manager' (a4e1531c-fb58-44f4-a3e2-f2097cd992ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:44 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3d2cb356-f51f-4ceb-a329-36010fe6a2dc tempest-VolumesExtendTest-493201748 None] Created volume successfully.
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-64cbae40-33f3-479d-ad05-82e75e056816-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-64cbae40-33f3-479d-ad05-82e75e056816-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-64cbae40-33f3-479d-ad05-82e75e056816" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-64cbae40-33f3-479d-ad05-82e75e056816" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e23d313-7ac5-4b9c-8a1e-6d2b02c138ba]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:44 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816
Nov 05 03:55:44 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:45 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:45 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816
Nov 05 03:55:45 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:45 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-64cbae40-33f3-479d-ad05-82e75e056816" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-64cbae40-33f3-479d-ad05-82e75e056816" released by "delete_volume" :: held 0.644s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['d9937f54-7bb4-4e8d-a88b-295b62b6eaf3', 'f33916a6-c0ee-4492-b27a-0ae4f306033b', 'fa7c9e24-d3bc-490b-b1f2-f5a9255dea81', '6763c467-bbdb-4828-ba14-2672678dfa64'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:45 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:45 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Creating offline snapshot 7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a of volume b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d030b51b-d5b9-4638-b9f4-d06739a20a42]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:45 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63
Nov 05 03:55:45 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:45 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.280s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Deleted volume successfully.
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-f76eb768-cd38-4e4e-a944-ff8db87755fa-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fd8b43e3-304e-41fa-bd8e-7438c72c71ab tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-64cbae40-33f3-479d-ad05-82e75e056816-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-f76eb768-cd38-4e4e-a944-ff8db87755fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-91db0f06-2736-46d8-846a-863ca10240be" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-91db0f06-2736-46d8-846a-863ca10240be" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-f76eb768-cd38-4e4e-a944-ff8db87755fa" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-f76eb768-cd38-4e4e-a944-ff8db87755fa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Deleting offline snapshot f76eb768-cd38-4e4e-a944-ff8db87755fa of volume 91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] snapshot_file for this snap is: volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c84157-2004-47ac-baf6-1e99342d5754]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:46 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa
Nov 05 03:55:46 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:46 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:46 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a 1G
Nov 05 03:55:46 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:46 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db0f06-2736-46d8-846a-863ca10240be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b204f07-ded8-4484-86b7-ec8a81b5efc0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:46 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be
Nov 05 03:55:46 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:46 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a 1G" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:46 devstack sudo[100864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a
Nov 05 03:55:46 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:46 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:46 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a is being set with open permissions: ugo+rw
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:46 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a
Nov 05 03:55:46 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:46 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be" returned: 0 in 0.583s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:46 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa
Nov 05 03:55:46 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:47 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:47 devstack sudo[100879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.info
Nov 05 03:55:47 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:47 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:47 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa
Nov 05 03:55:47 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:47 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.info" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:47 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.info is being set with open permissions: ugo+rw
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:47 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.info
Nov 05 03:55:47 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:47 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be.f76eb768-cd38-4e4e-a944-ff8db87755fa" returned: 0 in 0.263s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-f76eb768-cd38-4e4e-a944-ff8db87755fa" released by "_delete_snapshot" :: held 1.700s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-91db0f06-2736-46d8-846a-863ca10240be" released by "delete_snapshot" :: held 1.729s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['d02b91c6-f2d8-48f5-ab4e-6e1c3c574561', 'a57cfe41-2be0-4acf-9bb4-e61484d5d449', '99852f44-6d9f-4f17-a962-a0d5f04878ec', 'fe96dd6d-bf24-4570-ace5-d62a57b8cc0e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Delete snapshot completed successfully.
Nov 05 03:55:47 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.info" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-73dbdf9d-18c6-4181-92bd-44e19506666d tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-f76eb768-cd38-4e4e-a944-ff8db87755fa-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b664d7e0-365a-4e11-ac2f-41dc3715b039 tempest-VolumesExtendTest-493201748 None] Create snapshot completed successfully
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-91db0f06-2736-46d8-846a-863ca10240be-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-91db0f06-2736-46d8-846a-863ca10240be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-91db0f06-2736-46d8-846a-863ca10240be" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-91db0f06-2736-46d8-846a-863ca10240be" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39dc024-8577-4376-b68e-56293feedae2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:48 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be
Nov 05 03:55:48 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:48 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:48 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be
Nov 05 03:55:48 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:48 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-91db0f06-2736-46d8-846a-863ca10240be" returned: 0 in 0.241s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-91db0f06-2736-46d8-846a-863ca10240be" released by "delete_volume" :: held 0.677s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['7577b74f-97f3-43b3-94b8-a542de16d4a6', '7c4f2014-c7e1-48b1-b3ef-6ef8e80cbb6d', '2aa4ec75-7b9c-40cc-9c9b-1bd71398122f', '24648916-04c9-40d0-a6d5-f018a25042ef'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c081bf-f40b-43a2-8731-5f0043520537]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:49 devstack sudo[100900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:49 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:49 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63
Nov 05 03:55:49 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:49 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Deleted volume successfully.
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30126db0-83f6-4ef8-82df-451063faff9f tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-91db0f06-2736-46d8-846a-863ca10240be-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:49 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63" returned: 0 in 0.498s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a 2G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a 2G" returned: 0 in 0.151s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.710s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-faeebfc2-3c5e-494c-8c43-b023a5102fb7 tempest-VolumesExtendTest-493201748 None] Extend volume completed successfully.
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (30a16ba0-8a66-4730-9906-612545ece152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62de854-a103-469d-bed6-abe413e61dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62de854-a103-469d-bed6-abe413e61dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1403021598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61afeeb5-7dab-4d39-968c-9ef9d49ebd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:50Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa53fe21-0685-4b00-80b7-2df8a265ca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa53fe21-0685-4b00-80b7-2df8a265ca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af51a66a-4ee3-4d2b-abfb-a52c1e207f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af51a66a-4ee3-4d2b-abfb-a52c1e207f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61afeeb5-7dab-4d39-968c-9ef9d49ebd3e', 'volume_name': 'volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bca53d-a030-4f50-9d13-54a5c58fd0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bca53d-a030-4f50-9d13-54a5c58fd0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e7554e-0c05-456c-87e3-8febdb437830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Volume 61afeeb5-7dab-4d39-968c-9ef9d49ebd3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e', 'volume_size': 1}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1403021598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61afeeb5-7dab-4d39-968c-9ef9d49ebd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:50Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Creating volume 61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:50 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:50 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e 1073741824
Nov 05 03:55:50 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Acquiring lock "cinder-7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Lock "cinder-7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Acquiring lock "cinder-quobyte-b52c7bb4-ff81-46a4-84de-a6507ce70a63" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-b52c7bb4-ff81-46a4-84de-a6507ce70a63" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Acquiring lock "cinder-quobyte-7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Deleting offline snapshot 7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a of volume b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] snapshot_file for this snap is: volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[700db3bf-109b-46f4-87e6-5e9bae9a9687]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:50 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a
Nov 05 03:55:50 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:50 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e 1073741824" returned: 0 in 0.576s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:50 devstack sudo[100933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e
Nov 05 03:55:50 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:50 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" returned: 0 in 0.438s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558ffb4-f265-4533-b72e-2e6f2d676b9c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:50 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:50 devstack sudo[100938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63
Nov 05 03:55:50 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e7554e-0c05-456c-87e3-8febdb437830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595440cb-0677-4b1d-a010-d8c9a2aacc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Volume volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e (61afeeb5-7dab-4d39-968c-9ef9d49ebd3e): created successfully
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595440cb-0677-4b1d-a010-d8c9a2aacc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (30a16ba0-8a66-4730-9906-612545ece152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9f3ed03d-be83-4f7b-baba-5e45b97e6c46 tempest-VolumesSnapshotTestJSON-1124376948 None] Created volume successfully.
Nov 05 03:55:51 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:51 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a
Nov 05 03:55:51 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:51 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" returned: 0 in 0.357s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:51 devstack sudo[100949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a
Nov 05 03:55:51 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:51 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63.7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a" released by "_delete_snapshot" :: held 1.567s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-b52c7bb4-ff81-46a4-84de-a6507ce70a63" released by "delete_snapshot" :: held 1.595s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Created reservations ['a7ac78b7-6d7e-43f2-b1fc-10380a447bc2', '36278469-ba2f-47ec-a0e2-e6e03e62fffa', '761629a6-19fa-4f2e-86e8-31117684bb62', 'aabc11d9-2eb9-4bc9-9802-0aefec3fa61b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Delete snapshot completed successfully.
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a38de204-bdd0-40d3-afc6-b6bb4804175f tempest-VolumesExtendTest-493201748 None] Lock "cinder-7cb5bbf2-a4bd-4e8b-9588-7f6295616b0a-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Creating offline snapshot 0f1295de-b65e-44fd-9796-1a9066195b91 of volume 61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e85c315-a5e0-44ea-9edf-b81597277ed9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:52 devstack sudo[100952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e
Nov 05 03:55:52 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Acquiring lock "cinder-b52c7bb4-ff81-46a4-84de-a6507ce70a63-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Lock "cinder-b52c7bb4-ff81-46a4-84de-a6507ce70a63-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Acquiring lock "cinder-quobyte-b52c7bb4-ff81-46a4-84de-a6507ce70a63" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-b52c7bb4-ff81-46a4-84de-a6507ce70a63" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bfd790-1d53-4a80-82c7-0ee9b55a4a06]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:52 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" returned: 0 in 0.434s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:52 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 1G
Nov 05 03:55:52 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:52 devstack sudo[100957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63
Nov 05 03:55:52 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 1G" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91
Nov 05 03:55:53 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[100970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63
Nov 05 03:55:53 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b52c7bb4-ff81-46a4-84de-a6507ce70a63" returned: 0 in 0.261s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Lock "cinder-quobyte-b52c7bb4-ff81-46a4-84de-a6507ce70a63" released by "delete_volume" :: held 0.765s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 is being set with open permissions: ugo+rw
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91
Nov 05 03:55:53 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Created reservations ['f36899c7-4aae-4b48-90c4-456efc39cf4a', '3b3fa477-9b5f-4ab9-b3cd-09df2b2c532f', 'b54a1c0a-e4b5-43dc-8c85-ac68c3374041', '4f1abfd3-5942-4d1c-9e61-b7e105aa4c01'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:55:53 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.info
Nov 05 03:55:53 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Deleted volume successfully.
Nov 05 03:55:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e909dab-e012-427a-a2a9-1ecc6c56a59b tempest-VolumesExtendTest-493201748 None] Lock "cinder-b52c7bb4-ff81-46a4-84de-a6507ce70a63-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:54 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.info" returned: 0 in 0.372s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:54 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.info is being set with open permissions: ugo+rw
Nov 05 03:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:54 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.info
Nov 05 03:55:54 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:54 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.info" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d7e1355c-e42c-479c-8c2a-fa344063b740 tempest-VolumesSnapshotTestJSON-1124376948 None] Create snapshot completed successfully
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (ac9a5a43-189b-426e-8e74-afcbd5ed48e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3f7f2f-ab68-4acd-a6a2-b4163f0c6004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3f7f2f-ab68-4acd-a6a2-b4163f0c6004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1072604586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f334aa-92ac-4005-b776-9da59416476c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1514e14858cf400b8d45cba0c7661b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f1295de-b65e-44fd-9796-1a9066195b91,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:56Z,use_quota=True,user_id='46fcdf0346194bf8bee3d0c8f9f33f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd91c12-85d5-4188-9586-66f0b03e0f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd91c12-85d5-4188-9586-66f0b03e0f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9149e0ba-7690-44b5-a3f8-41eceedf5deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9149e0ba-7690-44b5-a3f8-41eceedf5deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '56f334aa-92ac-4005-b776-9da59416476c', 'volume_name': 'volume-56f334aa-92ac-4005-b776-9da59416476c', 'volume_size': 1, 'snapshot_id': '0f1295de-b65e-44fd-9796-1a9066195b91'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a601462-50f6-457d-9f75-76d097969f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a601462-50f6-457d-9f75-76d097969f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2162632-c4ee-4cda-8632-141efe477ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:56 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Volume 56f334aa-92ac-4005-b776-9da59416476c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-56f334aa-92ac-4005-b776-9da59416476c', 'volume_size': 1, 'snapshot_id': '0f1295de-b65e-44fd-9796-1a9066195b91'}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-0f1295de-b65e-44fd-9796-1a9066195b91-56f334aa-92ac-4005-b776-9da59416476c" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-0f1295de-b65e-44fd-9796-1a9066195b91-56f334aa-92ac-4005-b776-9da59416476c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Creating volume 56f334aa-92ac-4005-b776-9da59416476c from snapshot 0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-56f334aa-92ac-4005-b776-9da59416476c" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-56f334aa-92ac-4005-b776-9da59416476c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] snapshot: 0f1295de-b65e-44fd-9796-1a9066195b91, volume: 56f334aa-92ac-4005-b776-9da59416476c,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed87c02-2f67-413e-97ce-cda327a001bb]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:56 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91
Nov 05 03:55:56 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:56 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cedffc-1dd5-4d84-830d-636c219ff27e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:56 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e
Nov 05 03:55:56 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:57 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:55:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:55:57 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:55:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:57 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c
Nov 05 03:55:57 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=117,cinder:UPDATE=120,cinder:DELETE=10,cinder:INSERT=31 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Flow 'volume_create_manager' (71fc0a0e-6796-4f18-a377-3baf756d1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9219b7c9-4d7a-4f40-9c8d-1d40dd032ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9219b7c9-4d7a-4f40-9c8d-1d40dd032ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-852339044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a707fc09-9169-47de-a752-17d2d16e317e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3dc2a1cc4845ba9796aa14694f9b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:03Z,use_quota=True,user_id='47908aa67135417b9909a6ea9299b9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0f01f0-68da-45c9-9421-d4b13a4a9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0f01f0-68da-45c9-9421-d4b13a4a9232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70f775a-b42a-4201-aa73-45a1ca8c5dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70f775a-b42a-4201-aa73-45a1ca8c5dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a707fc09-9169-47de-a752-17d2d16e317e', 'volume_name': 'volume-a707fc09-9169-47de-a752-17d2d16e317e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06ea747-1e5d-44c0-bfff-20f5fe80f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06ea747-1e5d-44c0-bfff-20f5fe80f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c0652c-dc86-4fb5-a8e7-2cf81d262b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Volume a707fc09-9169-47de-a752-17d2d16e317e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a707fc09-9169-47de-a752-17d2d16e317e', 'volume_size': 1}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:03 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c" returned: 0 in 6.748s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:56:03 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Converted 1024.00 MB image at 151.74 MB/s
Nov 05 03:56:03 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c is being set with open permissions: ugo+rw
Nov 05 03:56:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:03 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c
Nov 05 03:56:03 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:04 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c" returned: 0 in 0.229s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-56f334aa-92ac-4005-b776-9da59416476c" released by "_copy_volume_from_snapshot" :: held 7.882s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-0f1295de-b65e-44fd-9796-1a9066195b91-56f334aa-92ac-4005-b776-9da59416476c" released by "_create_volume_from_snapshot" :: held 7.945s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.961s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-852339044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a707fc09-9169-47de-a752-17d2d16e317e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3dc2a1cc4845ba9796aa14694f9b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:03Z,use_quota=True,user_id='47908aa67135417b9909a6ea9299b9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Creating volume a707fc09-9169-47de-a752-17d2d16e317e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:04 devstack sudo[101018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e 1073741824
Nov 05 03:56:04 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2162632-c4ee-4cda-8632-141efe477ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f334aa-92ac-4005-b776-9da59416476c', 'volume_size': 1, 'snapshot_id': '0f1295de-b65e-44fd-9796-1a9066195b91'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf792535-142b-408b-bb1e-bf063dfd01dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Volume volume-56f334aa-92ac-4005-b776-9da59416476c (56f334aa-92ac-4005-b776-9da59416476c): created successfully
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf792535-142b-408b-bb1e-bf063dfd01dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Flow 'volume_create_manager' (ac9a5a43-189b-426e-8e74-afcbd5ed48e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-53deddfa-6eb8-4d05-8298-9493d2ac847e tempest-VolumesSnapshotTestJSON-1124376948 None] Created volume successfully.
Nov 05 03:56:04 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e 1073741824" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:04 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e
Nov 05 03:56:04 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:04 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c0652c-dc86-4fb5-a8e7-2cf81d262b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a707fc09-9169-47de-a752-17d2d16e317e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5298de43-17c6-4b01-b6c6-4cd84925eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Volume volume-a707fc09-9169-47de-a752-17d2d16e317e (a707fc09-9169-47de-a752-17d2d16e317e): created successfully
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5298de43-17c6-4b01-b6c6-4cd84925eeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Flow 'volume_create_manager' (71fc0a0e-6796-4f18-a377-3baf756d1552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-326f2c46-d977-4972-8186-444883a8afc9 tempest-VolumesNegativeTest-1321582535 None] Created volume successfully.
Nov 05 03:56:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-56f334aa-92ac-4005-b776-9da59416476c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-56f334aa-92ac-4005-b776-9da59416476c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-56f334aa-92ac-4005-b776-9da59416476c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-56f334aa-92ac-4005-b776-9da59416476c" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[400d84bb-7bed-4bb4-b466-cedfd7b2a06e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:05 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c
Nov 05 03:56:05 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:05 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:05 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c
Nov 05 03:56:05 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:05 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-56f334aa-92ac-4005-b776-9da59416476c" returned: 0 in 0.241s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-56f334aa-92ac-4005-b776-9da59416476c" released by "delete_volume" :: held 0.658s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['3cb122f0-1377-4a40-a2a7-3d6f482622e2', '0549462d-d498-4ec1-b293-25bcfdef414b', '544f0a4a-e7e9-48e4-81d6-37449563cafc', '2b8e6af5-7ab3-4790-bbaa-4c387f0d4d1f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:06 devstack sudo[101034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:06 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-0f1295de-b65e-44fd-9796-1a9066195b91-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:06 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.293s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-0f1295de-b65e-44fd-9796-1a9066195b91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Deleted volume successfully.
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-0f1295de-b65e-44fd-9796-1a9066195b91" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca6a8a56-c9bb-4919-9139-e183467315da tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-56f334aa-92ac-4005-b776-9da59416476c-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-0f1295de-b65e-44fd-9796-1a9066195b91" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Deleting offline snapshot 0f1295de-b65e-44fd-9796-1a9066195b91 of volume 61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] snapshot_file for this snap is: volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9f2241-dbfb-4ae8-a0cf-37295ee8ccbf]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:06 devstack sudo[101040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91
Nov 05 03:56:06 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:06 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d4a325-c284-4dd7-859e-6cdabbc97bbb]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:06 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e
Nov 05 03:56:06 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:07 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" returned: 0 in 0.554s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:07 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91
Nov 05 03:56:07 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:07 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91" returned: 0 in 0.397s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:07 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91
Nov 05 03:56:07 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:08 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e.0f1295de-b65e-44fd-9796-1a9066195b91" returned: 0 in 0.290s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-0f1295de-b65e-44fd-9796-1a9066195b91" released by "_delete_snapshot" :: held 1.746s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" released by "delete_snapshot" :: held 1.787s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['e343d8a5-9b57-4b50-be4f-939591e27a9a', '0e8b0821-0a76-49f3-bc69-8de15b5ff793', 'daa433ba-20e9-4685-907e-f9a657254b40', '98b8f812-1659-494c-b00e-6bcdece417a3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Delete snapshot completed successfully.
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f08c2bef-6a22-4104-8ed3-335f295dcfe7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-0f1295de-b65e-44fd-9796-1a9066195b91-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff25a8-453c-47fd-bb70-96070f3b76f0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:08 devstack sudo[101074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e
Nov 05 03:56:08 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:09 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:09 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e
Nov 05 03:56:09 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:09 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" returned: 0 in 0.262s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e" released by "delete_volume" :: held 0.780s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['8777f40a-a602-4b3d-9f73-2a3fc88c66c9', '9bb9829a-c541-41af-9188-5e76a31c298c', 'f9f3553b-c738-456b-abca-1758600e36a7', '894afd74-4c00-46fb-bad4-1b707cf2318b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:09 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:09 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-5eafcab1-dcbb-49d2-85eb-57fbb6831522-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-5eafcab1-dcbb-49d2-85eb-57fbb6831522-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:09 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Deleted volume successfully.
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "cinder-quobyte-5eafcab1-dcbb-49d2-85eb-57fbb6831522" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-5eafcab1-dcbb-49d2-85eb-57fbb6831522" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feef9ed1-062e-4d0b-804a-537f39ac49c7 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-61afeeb5-7dab-4d39-968c-9ef9d49ebd3e-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff30c9-7a39-4bd4-8244-a7e264a83f99]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:10 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522
Nov 05 03:56:10 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:10 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:10 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522
Nov 05 03:56:10 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:10 devstack sudo[101114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:10 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:10 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5eafcab1-dcbb-49d2-85eb-57fbb6831522" returned: 0 in 0.586s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-quobyte-5eafcab1-dcbb-49d2-85eb-57fbb6831522" released by "delete_volume" :: held 1.122s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Created reservations ['efcd53c5-cb4c-4b0f-a71d-3c7a9abe8fb1', '0b061561-f615-4627-ad3e-5470dfdcbeda', '47743c30-c3eb-478c-a326-840b3f991edb', 'a3500eb7-f8da-4754-9073-529d38789ab8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:11 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:11 devstack sudo[101158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:11 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:11 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.485s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Deleted volume successfully.
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4bea62d-5102-4138-bdee-f5ee3c63a094 tempest-VolumesSnapshotTestJSON-1124376948 None] Lock "cinder-5eafcab1-dcbb-49d2-85eb-57fbb6831522-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f9d1e295-c84f-445c-bdff-e8293f5ab265 req-f76652b8-c8f7-4b2b-bbbc-d1b1395620b7 tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f9d1e295-c84f-445c-bdff-e8293f5ab265 req-f76652b8-c8f7-4b2b-bbbc-d1b1395620b7 tempest-TestStampPattern-639214097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f9d1e295-c84f-445c-bdff-e8293f5ab265 req-f76652b8-c8f7-4b2b-bbbc-d1b1395620b7 tempest-TestStampPattern-639214097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-f9d1e295-c84f-445c-bdff-e8293f5ab265 req-f76652b8-c8f7-4b2b-bbbc-d1b1395620b7 tempest-TestStampPattern-639214097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b855527-b207-41d1-8daa-7b0a809527bd', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:56:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-f9d1e295-c84f-445c-bdff-e8293f5ab265 req-f76652b8-c8f7-4b2b-bbbc-d1b1395620b7 tempest-TestStampPattern-639214097 None] attachment_update completed successfully.
Nov 05 03:56:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-cbf39bfc-06aa-42d8-b79e-0cdb246e9b1c req-40e1bab4-26ea-45fc-98de-b804a1535b13 tempest-TestStampPattern-639214097 None] Terminate volume connection completed successfully.
Nov 05 03:56:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-cbf39bfc-06aa-42d8-b79e-0cdb246e9b1c req-40e1bab4-26ea-45fc-98de-b804a1535b13 tempest-TestStampPattern-639214097 None] Deleting attachment 5b855527-b207-41d1-8daa-7b0a809527bd. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Lock "cinder-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-quobyte-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7523d7d0-9ad0-45ef-9c54-e8fcf17fb9cb]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:20 devstack sudo[101698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490
Nov 05 03:56:20 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:20 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:20 devstack sudo[101704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490
Nov 05 03:56:20 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:21 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490" released by "delete_volume" :: held 0.813s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Created reservations ['f13453e8-1a2a-4024-ac73-6d37768c5a4f', '84696be2-5701-4bf4-be88-836c31de3286', 'df077481-bbe9-4218-be44-53fce07dba11', 'e0f70dd7-1244-4434-b38f-baa052deab07'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:21 devstack sudo[101708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:21 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:21 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Deleted volume successfully.
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18a1a311-f310-4430-bff4-e7945be00f7e tempest-TestStampPattern-639214097 None] Lock "cinder-c3a74c73-5a6a-4d58-aeb7-9f1a91c4e490-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-5a5a7896-aac3-4aa8-8a2c-79f877cf654f-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Lock "cinder-5a5a7896-aac3-4aa8-8a2c-79f877cf654f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-quobyte-e1fb4e7e-32d5-49cf-9111-45f2638f776e" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-e1fb4e7e-32d5-49cf-9111-45f2638f776e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-quobyte-5a5a7896-aac3-4aa8-8a2c-79f877cf654f" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-5a5a7896-aac3-4aa8-8a2c-79f877cf654f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Deleting offline snapshot 5a5a7896-aac3-4aa8-8a2c-79f877cf654f of volume e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] snapshot_file for this snap is: volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814b51b-134d-400c-88e3-3ff0b353286b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:22 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f
Nov 05 03:56:22 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:22 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:56:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7a9d6-69d9-497c-a378-589218a94e6e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:22 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e
Nov 05 03:56:22 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:23 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e" returned: 0 in 0.647s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:23 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f
Nov 05 03:56:23 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Flow 'volume_create_manager' (ecff3012-2f9f-4da4-a5e4-c31f78552191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26452d7f-dd50-4ae9-a9dd-f260587652c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26452d7f-dd50-4ae9-a9dd-f260587652c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1532872709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b8ad38-9749-4b25-b2f8-68c2666e1377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5f26de815a4d3285a8243c6450e27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:23Z,use_quota=True,user_id='d2e6e088edaf4cc785a77f2e9d7c5b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714af645-d057-47cc-8675-7674fcdffb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714af645-d057-47cc-8675-7674fcdffb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f63188-8e2f-436c-b21f-8c7e357bb651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f63188-8e2f-436c-b21f-8c7e357bb651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b8ad38-9749-4b25-b2f8-68c2666e1377', 'volume_name': 'volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebba2c27-3e52-4e91-8e2c-406f1b5c436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebba2c27-3e52-4e91-8e2c-406f1b5c436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f247bde-7ed8-40f4-b5ac-330ba99a8012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Volume c3b8ad38-9749-4b25-b2f8-68c2666e1377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377', 'volume_size': 2}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1532872709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b8ad38-9749-4b25-b2f8-68c2666e1377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5f26de815a4d3285a8243c6450e27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:23Z,use_quota=True,user_id='d2e6e088edaf4cc785a77f2e9d7c5b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Creating volume c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:23 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 2147483648 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:23 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 2147483648
Nov 05 03:56:23 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:23 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:23 devstack sudo[101729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f
Nov 05 03:56:23 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:23 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e.5a5a7896-aac3-4aa8-8a2c-79f877cf654f" returned: 0 in 0.281s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-5a5a7896-aac3-4aa8-8a2c-79f877cf654f" released by "_delete_snapshot" :: held 1.924s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-e1fb4e7e-32d5-49cf-9111-45f2638f776e" released by "delete_snapshot" :: held 1.956s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:23 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 2147483648" returned: 0 in 0.579s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:23 devstack sudo[101736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377
Nov 05 03:56:23 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Created reservations ['6b87ff04-6664-43ad-82bb-b12649f5ff56', '9d9eb39a-f18d-4f1c-b494-75a3b3cf13ff', '6273e8e0-be59-4f0b-a0e1-6cf0e104c37b', 'f57a1e1f-fc7b-47d4-a541-0072e64ca880'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Delete snapshot completed successfully.
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-66d8e7ea-ecdd-4036-b7da-f15f2b903fef tempest-TestStampPattern-639214097 None] Lock "cinder-5a5a7896-aac3-4aa8-8a2c-79f877cf654f-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:24 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f247bde-7ed8-40f4-b5ac-330ba99a8012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084c5050-f0ad-4f1f-bfcc-04ace0694fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Volume volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 (c3b8ad38-9749-4b25-b2f8-68c2666e1377): created successfully
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084c5050-f0ad-4f1f-bfcc-04ace0694fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Flow 'volume_create_manager' (ecff3012-2f9f-4da4-a5e4-c31f78552191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-40e3037b-3268-4153-9509-29a77e0323f7 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Created volume successfully.
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Acquiring lock "cinder-a707fc09-9169-47de-a752-17d2d16e317e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Lock "cinder-a707fc09-9169-47de-a752-17d2d16e317e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Acquiring lock "cinder-quobyte-a707fc09-9169-47de-a752-17d2d16e317e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Lock "cinder-quobyte-a707fc09-9169-47de-a752-17d2d16e317e" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a4ad5-7cf3-4abb-903b-f67e14d413ce]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:25 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e
Nov 05 03:56:25 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Creating offline snapshot b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 of volume c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c46a62-1f20-48f5-9e7c-4d0cd3a25d10]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:25 devstack sudo[101741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377
Nov 05 03:56:25 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:25 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e" returned: 0 in 0.451s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:25 devstack sudo[101748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e
Nov 05 03:56:25 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:26 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377" returned: 0 in 0.444s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 2G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:26 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 2G
Nov 05 03:56:26 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:26 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a707fc09-9169-47de-a752-17d2d16e317e" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Lock "cinder-quobyte-a707fc09-9169-47de-a752-17d2d16e317e" released by "delete_volume" :: held 0.868s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Created reservations ['57aab01e-992f-47f8-a21d-bd7055115d6e', 'e12ecddc-c938-4818-9281-73f956a41f8e', '629523fe-c3e5-4b81-998b-9a9786a89a8a', '17109a09-e424-4d01-9f04-578445fe7662'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:26 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:26 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:26 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 2G" returned: 0 in 0.782s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:26 devstack sudo[101781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722
Nov 05 03:56:26 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:27 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Deleted volume successfully.
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-016e9ce2-69f1-456d-9a83-377a70088ac3 tempest-VolumesNegativeTest-1321582535 None] Lock "cinder-a707fc09-9169-47de-a752-17d2d16e317e-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:27 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:27 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 is being set with open permissions: ugo+rw
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:27 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722
Nov 05 03:56:27 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:27 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:27 devstack sudo[101795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.info
Nov 05 03:56:27 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:27 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.info" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:27 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.info is being set with open permissions: ugo+rw
Nov 05 03:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:27 devstack sudo[101800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.info
Nov 05 03:56:27 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:28 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.info" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=127,cinder:DELETE=14,cinder:SELECT=122,cinder:INSERT=40 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4a6184d4-427a-46ad-97e1-4968e87fc54c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Create snapshot completed successfully
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "cinder-b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "cinder-quobyte-c3b8ad38-9749-4b25-b2f8-68c2666e1377" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-quobyte-c3b8ad38-9749-4b25-b2f8-68c2666e1377" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "cinder-quobyte-b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-quobyte-b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Deleting offline snapshot b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 of volume c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] snapshot_file for this snap is: volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaa68e0-589f-4def-9def-9c7c12b0a615]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:29 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722
Nov 05 03:56:29 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-e1fb4e7e-32d5-49cf-9111-45f2638f776e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Lock "cinder-e1fb4e7e-32d5-49cf-9111-45f2638f776e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Acquiring lock "cinder-quobyte-e1fb4e7e-32d5-49cf-9111-45f2638f776e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-e1fb4e7e-32d5-49cf-9111-45f2638f776e" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2ee9f1-5c47-4652-89de-28fc23e58c5f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:29 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" returned: 0 in 0.452s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0211b9-79f3-456f-a85c-ee762305ea4c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:29 devstack sudo[101809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e
Nov 05 03:56:29 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:29 devstack sudo[101810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377
Nov 05 03:56:29 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:29 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:29 devstack sudo[101816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e
Nov 05 03:56:29 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:29 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:29 devstack sudo[101822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722
Nov 05 03:56:29 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:30 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e1fb4e7e-32d5-49cf-9111-45f2638f776e" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Lock "cinder-quobyte-e1fb4e7e-32d5-49cf-9111-45f2638f776e" released by "delete_volume" :: held 0.755s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Created reservations ['fd77fcda-609a-47b4-8ca8-230fa4911ff9', '361f365d-a8e6-4474-a98b-010c202dca9f', '4d84f517-b5e9-4c90-8d03-c93ffbf66ce7', 'a338af98-6bdb-497f-a25d-dab9e1f90f28'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:30 devstack sudo[101830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:30 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:30 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" returned: 0 in 0.429s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:30 devstack sudo[101832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722
Nov 05 03:56:30 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:30 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Deleted volume successfully.
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-59afa663-fec8-4d3f-831c-89e32bed7bc7 tempest-TestStampPattern-639214097 None] Lock "cinder-e1fb4e7e-32d5-49cf-9111-45f2638f776e-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:30 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377.b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" returned: 0 in 0.387s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-quobyte-b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722" released by "_delete_snapshot" :: held 1.833s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-quobyte-c3b8ad38-9749-4b25-b2f8-68c2666e1377" released by "delete_snapshot" :: held 1.867s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Created reservations ['6c1a9942-985e-49e9-a16e-70c206f2e58a', '93426571-0e77-4900-b5e3-8b2ece12ffb2', '5b1a65ee-5f8d-42de-bc70-127ae07538d6', '933b8aaa-9059-43f5-b4e0-4550d95c4dfa'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Delete snapshot completed successfully.
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cbfa8105-0839-40a3-baf4-730c5d6a2a62 tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-b1d07eb7-5d6e-442f-a0d2-6fa0c9cce722-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "cinder-c3b8ad38-9749-4b25-b2f8-68c2666e1377-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-c3b8ad38-9749-4b25-b2f8-68c2666e1377-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "cinder-quobyte-c3b8ad38-9749-4b25-b2f8-68c2666e1377" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-quobyte-c3b8ad38-9749-4b25-b2f8-68c2666e1377" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2c103e-caf7-4fc0-9552-e0ebd08fd775]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:31 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377
Nov 05 03:56:31 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:31 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377" returned: 0 in 0.508s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:31 devstack sudo[101841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377
Nov 05 03:56:31 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:32 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c3b8ad38-9749-4b25-b2f8-68c2666e1377" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-quobyte-c3b8ad38-9749-4b25-b2f8-68c2666e1377" released by "delete_volume" :: held 0.914s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Created reservations ['2a2a510c-fb00-43c2-b737-64858817734c', '643038a9-ec68-4d43-b3ea-4f6e4788d0ab', '8d8fd4f3-4223-4899-a53b-f214f2e6f2c7', 'fcea7898-2492-4b6d-8cdc-9089dfbd31bd'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:32 devstack sudo[101844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:56:32 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:32 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Deleted volume successfully.
Nov 05 03:56:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f0250ae-0447-4f27-8ae8-71e93241db0c tempest-VolumesSnapshotNegativeTestJSON-1971637413 None] Lock "cinder-c3b8ad38-9749-4b25-b2f8-68c2666e1377-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:42 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=19,cinder:SELECT=17,cinder:INSERT=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:42 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=92,cinder:SELECT=68,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (d8c33676-8113-494e-ab30-82d2f2d8b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0af09d-b0df-43a8-bc85-2a191333346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0af09d-b0df-43a8-bc85-2a191333346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1202400461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f7b5d-d407-473d-8337-0ca9d88c073a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:57Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2370d0ec-ce6a-4f1d-9a11-81577757817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2370d0ec-ce6a-4f1d-9a11-81577757817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aeab31-49ba-48c0-9ebf-8a1f58e49a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aeab31-49ba-48c0-9ebf-8a1f58e49a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994f7b5d-d407-473d-8337-0ca9d88c073a', 'volume_name': 'volume-994f7b5d-d407-473d-8337-0ca9d88c073a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981a1fb3-dc13-4765-941c-3eead7e3b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981a1fb3-dc13-4765-941c-3eead7e3b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb25687-4ad4-4a6b-a5fc-026113ef9f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Volume 994f7b5d-d407-473d-8337-0ca9d88c073a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994f7b5d-d407-473d-8337-0ca9d88c073a', 'volume_size': 1}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1202400461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f7b5d-d407-473d-8337-0ca9d88c073a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:57Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Creating volume 994f7b5d-d407-473d-8337-0ca9d88c073a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:57 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a 1073741824
Nov 05 03:56:57 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (f3dc99c2-017b-46e5-a307-53fcf4814db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d79a7c5-b73e-4095-a14a-43344271a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d79a7c5-b73e-4095-a14a-43344271a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1834417679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a278160f-4614-4840-9aaa-3704024c0612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:58Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdca4f6-b9e4-4ffb-aab8-cb0f7ac41e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdca4f6-b9e4-4ffb-aab8-cb0f7ac41e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff6ee1c-840e-4bd0-a414-2e391df4f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff6ee1c-840e-4bd0-a414-2e391df4f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a278160f-4614-4840-9aaa-3704024c0612', 'volume_name': 'volume-a278160f-4614-4840-9aaa-3704024c0612', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55cfcae-143e-4e89-8c5e-31974aa8a9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55cfcae-143e-4e89-8c5e-31974aa8a9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f193c-8328-4a1b-8ca6-022a6aff5f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Volume a278160f-4614-4840-9aaa-3704024c0612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a278160f-4614-4840-9aaa-3704024c0612', 'volume_size': 1}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:58 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a 1073741824" returned: 0 in 0.787s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (b56ea479-16fe-4a37-a93c-afc48347e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afac745-8236-46e1-9afc-0f2efea93a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afac745-8236-46e1-9afc-0f2efea93a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882128383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6a8deb-812f-41b3-b6c7-dc1fadd84e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:58Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1356668-d7b6-47e8-9458-57de9f3b2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1356668-d7b6-47e8-9458-57de9f3b2f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614d50ab-37cd-4ae9-ba93-5a9b43824bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614d50ab-37cd-4ae9-ba93-5a9b43824bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6a8deb-812f-41b3-b6c7-dc1fadd84e13', 'volume_name': 'volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f7d340-18d1-421c-bda6-e4a781f95f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f7d340-18d1-421c-bda6-e4a781f95f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace4fe78-7098-4c6e-adeb-9e5e26b1752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Volume 2c6a8deb-812f-41b3-b6c7-dc1fadd84e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13', 'volume_size': 1}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:58 devstack sudo[101904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a
Nov 05 03:56:58 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:58 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1834417679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a278160f-4614-4840-9aaa-3704024c0612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:58Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Creating volume a278160f-4614-4840-9aaa-3704024c0612 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:58 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:59 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612 1073741824
Nov 05 03:56:59 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb25687-4ad4-4a6b-a5fc-026113ef9f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994f7b5d-d407-473d-8337-0ca9d88c073a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f349d4f-9f77-4d5b-b230-726a4d5dcf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Volume volume-994f7b5d-d407-473d-8337-0ca9d88c073a (994f7b5d-d407-473d-8337-0ca9d88c073a): created successfully
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f349d4f-9f77-4d5b-b230-726a4d5dcf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (d8c33676-8113-494e-ab30-82d2f2d8b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (e3f39d0d-9f0b-4cc5-af2b-6e5a993c730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc339332-7c61-4d36-86d7-dfb48b9ffd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a9bda552-9616-42f8-92b5-608c245df413 tempest-CreateVolumesFromImageTest-1601897198 None] Created volume successfully.
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc339332-7c61-4d36-86d7-dfb48b9ffd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1284550587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf433df-3fee-4821-83a2-8d560a6bd787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:59Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040ca0f9-9937-47de-acab-6c5f23dba320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040ca0f9-9937-47de-acab-6c5f23dba320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca538c4-13b0-48ef-8e6d-d4bdf213ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca538c4-13b0-48ef-8e6d-d4bdf213ba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf433df-3fee-4821-83a2-8d560a6bd787', 'volume_name': 'volume-ebf433df-3fee-4821-83a2-8d560a6bd787', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f709d131-f8e3-4e37-89f8-10ad36502b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f709d131-f8e3-4e37-89f8-10ad36502b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3c198-5283-4d2e-b33a-3aa20236722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Volume ebf433df-3fee-4821-83a2-8d560a6bd787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf433df-3fee-4821-83a2-8d560a6bd787', 'volume_size': 1}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:59 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (c71b5b2f-6dc5-417a-b0ed-974d4b55f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06df6880-2525-44dd-b400-95f3738a2be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612 1073741824" returned: 0 in 0.718s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06df6880-2525-44dd-b400-95f3738a2be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458149610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:00Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0380797-a344-434e-9509-07c3503a6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0380797-a344-434e-9509-07c3503a6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d28ae2-ff46-4594-a96b-18bd80740d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d28ae2-ff46-4594-a96b-18bd80740d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e', 'volume_name': 'volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985da6b-be82-4dde-a3ac-e28a4ca96ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985da6b-be82-4dde-a3ac-e28a4ca96ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb80cdf5-7ff3-434b-a5c4-6d9a5b0344be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Volume 684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e', 'volume_size': 1}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:59 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612
Nov 05 03:56:59 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:00 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882128383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6a8deb-812f-41b3-b6c7-dc1fadd84e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:58Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Creating volume 2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f193c-8328-4a1b-8ca6-022a6aff5f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a278160f-4614-4840-9aaa-3704024c0612', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6265886-f509-4eb3-80b2-1ea5e6e28376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:00 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 1073741824
Nov 05 03:57:00 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Volume volume-a278160f-4614-4840-9aaa-3704024c0612 (a278160f-4614-4840-9aaa-3704024c0612): created successfully
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6265886-f509-4eb3-80b2-1ea5e6e28376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (f3dc99c2-017b-46e5-a307-53fcf4814db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4f2c8367-9b30-49b1-969e-218f8ee9124d tempest-CreateVolumesFromImageTest-1601897198 None] Created volume successfully.
Nov 05 03:57:00 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 1073741824" returned: 0 in 0.611s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:00 devstack sudo[101923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13
Nov 05 03:57:00 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:01 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1284550587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf433df-3fee-4821-83a2-8d560a6bd787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:59Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Creating volume ebf433df-3fee-4821-83a2-8d560a6bd787 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:01 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace4fe78-7098-4c6e-adeb-9e5e26b1752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:01 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787 1073741824
Nov 05 03:57:01 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24e6f04-f6c6-4c39-9a9a-65c7548ebb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Volume volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 (2c6a8deb-812f-41b3-b6c7-dc1fadd84e13): created successfully
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24e6f04-f6c6-4c39-9a9a-65c7548ebb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (b56ea479-16fe-4a37-a93c-afc48347e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-867bb1ba-6a1b-4b0f-b075-72cc097fcd6a tempest-CreateVolumesFromImageTest-1601897198 None] Created volume successfully.
Nov 05 03:57:01 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787 1073741824" returned: 0 in 0.587s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:01 devstack sudo[101932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787
Nov 05 03:57:01 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:02 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458149610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ccc1dff40845afb87bb751045627f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:00Z,use_quota=True,user_id='f283f241fc594d42bbe58877ba00198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Creating volume 684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:02 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3c198-5283-4d2e-b33a-3aa20236722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf433df-3fee-4821-83a2-8d560a6bd787', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:02 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e 1073741824
Nov 05 03:57:02 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d3a465-bab6-428b-9420-1d424fa8fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Volume volume-ebf433df-3fee-4821-83a2-8d560a6bd787 (ebf433df-3fee-4821-83a2-8d560a6bd787): created successfully
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d3a465-bab6-428b-9420-1d424fa8fef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (e3f39d0d-9f0b-4cc5-af2b-6e5a993c730c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1b28430b-bdb8-4e21-b589-e526d3e0dabd tempest-CreateVolumesFromImageTest-1601897198 None] Created volume successfully.
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Flow 'volume_create_manager' (ffd39142-841c-4203-af9a-cb36155cb2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1bef4f-661f-4737-bd27-d735c94fbad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1bef4f-661f-4737-bd27-d735c94fbad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1694545116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7d1956-358e-4553-9229-2978eaeca15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d81635dc146c1b9383219befce640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:03Z,use_quota=True,user_id='51cf8b06ca4041eab89449a6b7e0dd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f400e53-c73c-440a-a207-58350cceceb0),volume_type_id=6f400e53-c73c-440a-a207-58350cceceb0)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ff6ad5-c275-48aa-8806-12fcb5a6f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ff6ad5-c275-48aa-8806-12fcb5a6f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0addd3d4-92e9-434f-a3ec-60820bdce8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0addd3d4-92e9-434f-a3ec-60820bdce8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7d1956-358e-4553-9229-2978eaeca15c', 'volume_name': 'volume-7a7d1956-358e-4553-9229-2978eaeca15c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d9115a-7b70-4b6d-9995-98aae2f780c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d9115a-7b70-4b6d-9995-98aae2f780c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88002f5-7d30-42ea-a81a-fef953b6947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume 7a7d1956-358e-4553-9229-2978eaeca15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7d1956-358e-4553-9229-2978eaeca15c', 'volume_size': 1}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:02 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e 1073741824" returned: 0 in 0.684s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:02 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e
Nov 05 03:57:02 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Flow 'volume_create_manager' (59e1d0d5-c737-4220-9ed0-e4a74eab839a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861e0ef7-1ed3-497c-8ed6-a4e25776cef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:03 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1694545116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7d1956-358e-4553-9229-2978eaeca15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d81635dc146c1b9383219befce640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:03Z,use_quota=True,user_id='51cf8b06ca4041eab89449a6b7e0dd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f400e53-c73c-440a-a207-58350cceceb0),volume_type_id=6f400e53-c73c-440a-a207-58350cceceb0)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Creating volume 7a7d1956-358e-4553-9229-2978eaeca15c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:03 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861e0ef7-1ed3-497c-8ed6-a4e25776cef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1692285854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b899bd26-91ca-475f-ac29-ad67622d3d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d81635dc146c1b9383219befce640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:03Z,use_quota=True,user_id='51cf8b06ca4041eab89449a6b7e0dd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7658a7ad-eb9b-48f6-bb85-71fd5cf1d1ad),volume_type_id=7658a7ad-eb9b-48f6-bb85-71fd5cf1d1ad)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:03 devstack sudo[101944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c 1073741824
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8b31d-f2b3-4978-a9dc-9c7418844b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:03 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8b31d-f2b3-4978-a9dc-9c7418844b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a50edcb-3c81-4599-9b07-454e6e58bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a50edcb-3c81-4599-9b07-454e6e58bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b899bd26-91ca-475f-ac29-ad67622d3d7d', 'volume_name': 'volume-b899bd26-91ca-475f-ac29-ad67622d3d7d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1068921-2f42-4f2b-a1e5-d2d8dbff6e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1068921-2f42-4f2b-a1e5-d2d8dbff6e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e173a-4182-4d01-92a7-31ee2952ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume b899bd26-91ca-475f-ac29-ad67622d3d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b899bd26-91ca-475f-ac29-ad67622d3d7d', 'volume_size': 1}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb80cdf5-7ff3-434b-a5c4-6d9a5b0344be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59c2e8d-e407-4aac-bac8-f2cd7a0f86a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Volume volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e (684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e): created successfully
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59c2e8d-e407-4aac-bac8-f2cd7a0f86a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Flow 'volume_create_manager' (c71b5b2f-6dc5-417a-b0ed-974d4b55f510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1144cfd1-063d-4c83-a859-e42d15b2edec tempest-CreateVolumesFromImageTest-1601897198 None] Created volume successfully.
Nov 05 03:57:03 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c 1073741824" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:03 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c
Nov 05 03:57:03 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Flow 'volume_create_manager' (c4be078d-10b2-436a-b7e6-a395621f26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c535a3dc-771b-4d19-8e39-3678ad28dbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c535a3dc-771b-4d19-8e39-3678ad28dbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156731998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c8f0f4-055d-4343-b197-b51e958b8249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d81635dc146c1b9383219befce640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:04Z,use_quota=True,user_id='51cf8b06ca4041eab89449a6b7e0dd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dee01a0b-4b31-43a7-a7d3-c86dfd0d5b9c),volume_type_id=dee01a0b-4b31-43a7-a7d3-c86dfd0d5b9c)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be709f9d-128b-41cd-b251-99ec31958289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be709f9d-128b-41cd-b251-99ec31958289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab876a1-56b2-4e02-9dd0-ba70f31e52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:57:04 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1692285854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b899bd26-91ca-475f-ac29-ad67622d3d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d81635dc146c1b9383219befce640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:03Z,use_quota=True,user_id='51cf8b06ca4041eab89449a6b7e0dd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7658a7ad-eb9b-48f6-bb85-71fd5cf1d1ad),volume_type_id=7658a7ad-eb9b-48f6-bb85-71fd5cf1d1ad)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Creating volume b899bd26-91ca-475f-ac29-ad67622d3d7d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88002f5-7d30-42ea-a81a-fef953b6947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7d1956-358e-4553-9229-2978eaeca15c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f62ff0-28dd-4de9-a334-82fe1387bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:04 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d 1073741824
Nov 05 03:57:04 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume volume-7a7d1956-358e-4553-9229-2978eaeca15c (7a7d1956-358e-4553-9229-2978eaeca15c): created successfully
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f62ff0-28dd-4de9-a334-82fe1387bc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Flow 'volume_create_manager' (ffd39142-841c-4203-af9a-cb36155cb2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-66580ea7-16a8-416f-84b7-466044f542fe tempest-TestInstancesWithCinderVolumes-1233871322 None] Created volume successfully.
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab876a1-56b2-4e02-9dd0-ba70f31e52cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82c8f0f4-055d-4343-b197-b51e958b8249', 'volume_name': 'volume-82c8f0f4-055d-4343-b197-b51e958b8249', 'volume_size': 1, 'image_id': 'dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--873517575', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b5d81635dc146c1b9383219befce640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'created_at': datetime.datetime(2026, 11, 5, 2, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab58db260>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b8c86a-b4d3-4d74-b262-edf1083021da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b8c86a-b4d3-4d74-b262-edf1083021da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecca104-46bc-43be-a0ce-9fa29c73dc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume 82c8f0f4-055d-4343-b197-b51e958b8249: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82c8f0f4-055d-4343-b197-b51e958b8249', 'volume_size': 1, 'image_id': 'dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--873517575', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b5d81635dc146c1b9383219befce640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'created_at': datetime.datetime(2026, 11, 5, 2, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab58db260>}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Trying to clone 82c8f0f4-055d-4343-b197-b51e958b8249 from image dad1c44f-699e-4e74-a871-2f4ab089a0f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-quobyte-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ca48c-5def-401c-aaa2-172b1820d9dd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:04 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d 1073741824" returned: 0 in 0.678s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:04 devstack sudo[101961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d
Nov 05 03:57:04 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:04 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e
Nov 05 03:57:04 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:05 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d" returned: 0 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e173a-4182-4d01-92a7-31ee2952ed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b899bd26-91ca-475f-ac29-ad67622d3d7d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef9c1b6-bc38-4589-a6ee-bc275e87b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:05 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume volume-b899bd26-91ca-475f-ac29-ad67622d3d7d (b899bd26-91ca-475f-ac29-ad67622d3d7d): created successfully
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef9c1b6-bc38-4589-a6ee-bc275e87b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Flow 'volume_create_manager' (59e1d0d5-c737-4220-9ed0-e4a74eab839a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e" returned: 0 in 0.536s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9ee8798f-1db8-4d19-b66a-5a4a67a4b245 tempest-TestInstancesWithCinderVolumes-1233871322 None] Created volume successfully.
Nov 05 03:57:05 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e
Nov 05 03:57:05 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:05 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e" released by "delete_volume" :: held 0.941s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Created reservations ['cb78b385-18d6-4ae7-8d14-addde826a2b6', '76c49e85-2c79-46e4-a636-28a25521a827', 'f35b47e4-6c29-4a82-8749-c2b8b0e8e0fb', 'bd8f0276-0d79-4202-ab94-7ade5cfbac34'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:05 devstack sudo[101971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:05 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:06 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.323s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Deleted volume successfully.
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8a5624c-4da9-4492-8027-5005c7c9d360 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-684c39b0-22ee-42e3-b6e4-8ec7c1b5f43e-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-ebf433df-3fee-4821-83a2-8d560a6bd787-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-ebf433df-3fee-4821-83a2-8d560a6bd787-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-quobyte-ebf433df-3fee-4821-83a2-8d560a6bd787" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-ebf433df-3fee-4821-83a2-8d560a6bd787" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d236d6-16bd-47a1-ba62-5e8406c6feb5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:07 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787
Nov 05 03:57:07 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:07 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:07 devstack sudo[101979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787
Nov 05 03:57:07 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:07 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ebf433df-3fee-4821-83a2-8d560a6bd787" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-ebf433df-3fee-4821-83a2-8d560a6bd787" released by "delete_volume" :: held 0.752s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Created reservations ['b724d7e0-9ed3-49bf-8f05-3c9ce91bbabe', '563ce4c7-2927-45da-be14-949d91a4aa3d', '3461de1e-4f97-4c16-8892-ab3914d95cba', '7d612d2f-e158-4169-805a-5fefd58aa062'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:07 devstack sudo[101982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:07 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-quobyte-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:08 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.436s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Deleted volume successfully.
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab35d0fd-cd85-47bf-963c-2cc75387389b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa6c0b44-937f-4a68-9dfd-b7d7b8f5293d tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-ebf433df-3fee-4821-83a2-8d560a6bd787-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:08 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13
Nov 05 03:57:08 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:08 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13" returned: 0 in 0.500s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:08 devstack sudo[101990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13
Nov 05 03:57:08 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:09 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13" returned: 0 in 0.254s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13" released by "delete_volume" :: held 0.858s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Created reservations ['5de3303c-c6c6-4045-b55c-f11a1a6d6f10', 'dec28a29-7fff-48fc-85da-0e5a50c274ff', 'f74d521e-75ae-48e6-97aa-218347291d1b', 'af3a2e30-c034-4fc9-b8e0-5a171e087a8f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:09 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:09 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-a278160f-4614-4840-9aaa-3704024c0612-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-a278160f-4614-4840-9aaa-3704024c0612-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-quobyte-a278160f-4614-4840-9aaa-3704024c0612" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-a278160f-4614-4840-9aaa-3704024c0612" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f53af-f425-44e6-b95f-a5edf03578a0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:09 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Deleted volume successfully.
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9bb38929-284d-4e96-a5fb-a39ea47afeae tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-2c6a8deb-812f-41b3-b6c7-dc1fadd84e13-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD, size 20.69 MB, duration 5.15 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:57:09 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Image download 20.69 MB at 4.02 MB/s
Nov 05 03:57:09 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612
Nov 05 03:57:09 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5315699d-8376-453a-aadb-2f3aa0261b69]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:09 devstack sudo[101999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD
Nov 05 03:57:09 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:09 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612" returned: 0 in 0.462s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:10 devstack sudo[102004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612
Nov 05 03:57:10 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:10 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Temporary image dad1c44f-699e-4e74-a871-2f4ab089a0f1 is fetched for user 51cf8b06ca4041eab89449a6b7e0dd15. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:57:10 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fe4bee-60f1-4d7c-90c6-eb7f874dc8a1]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a278160f-4614-4840-9aaa-3704024c0612" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-a278160f-4614-4840-9aaa-3704024c0612" released by "delete_volume" :: held 0.837s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Created reservations ['55a287d5-e690-4ff4-a957-bcfa560c2ff8', 'd61806a3-96d5-4100-ac6e-068d1e355b2f', 'bf7f5724-6484-4c06-add1-2c6b17d1dec3', 'ea42fb10-79b5-4947-b7a2-fe0227a2c6dc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:10 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD
Nov 05 03:57:10 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:10 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:10 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-994f7b5d-d407-473d-8337-0ca9d88c073a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-994f7b5d-d407-473d-8337-0ca9d88c073a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:10 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156731998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c8f0f4-055d-4343-b197-b51e958b8249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d81635dc146c1b9383219befce640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:04Z,use_quota=True,user_id='51cf8b06ca4041eab89449a6b7e0dd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dee01a0b-4b31-43a7-a7d3-c86dfd0d5b9c),volume_type_id=dee01a0b-4b31-43a7-a7d3-c86dfd0d5b9c)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Creating volume 82c8f0f4-055d-4343-b197-b51e958b8249 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:10 devstack sudo[102019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:10 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:10 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:10 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 1073741824
Nov 05 03:57:10 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "cinder-quobyte-994f7b5d-d407-473d-8337-0ca9d88c073a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-994f7b5d-d407-473d-8337-0ca9d88c073a" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:10 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.330s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Deleted volume successfully.
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[81291dfb-db05-4af2-977c-253ba6eb08a1]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-094c7cd4-bc58-4ecb-acd5-2b7aed2baa16 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-a278160f-4614-4840-9aaa-3704024c0612-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:10 devstack sudo[102024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a
Nov 05 03:57:10 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:11 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.401s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:57:11 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 1073741824" returned: 0 in 0.544s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:11 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a" returned: 0 in 0.429s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:11 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a
Nov 05 03:57:11 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:11 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249
Nov 05 03:57:11 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:11 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249" returned: 0 in 0.295s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:11 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-994f7b5d-d407-473d-8337-0ca9d88c073a" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-quobyte-994f7b5d-d407-473d-8337-0ca9d88c073a" released by "delete_volume" :: held 0.839s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Attempting download of dad1c44f-699e-4e74-a871-2f4ab089a0f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'metadata': {}}])) to volume 82c8f0f4-055d-4343-b197-b51e958b8249. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Created reservations ['b3a59a30-8800-4003-8130-54612346f7a6', '9e5c07ae-c353-4f4e-8289-59d74d1acbcc', 'f32c207d-a5de-42cf-ba85-00f1c8b9bc0d', '06395709-b592-4e94-bbc7-41a92b191bf4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42fc93a-c74d-40dc-9ad0-29fc1c7efb42]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dad1c44f-699e-4e74-a871-2f4ab089a0f1_46wcar41 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:11 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dad1c44f-699e-4e74-a871-2f4ab089a0f1_46wcar41
Nov 05 03:57:11 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:11 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:11 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:12 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dad1c44f-699e-4e74-a871-2f4ab089a0f1_46wcar41" returned: 0 in 0.358s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dad1c44f-699e-4e74-a871-2f4ab089a0f1_46wcar41 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:12 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Deleted volume successfully.
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-395198d9-6a98-4fd7-be28-d8b063678c52 tempest-CreateVolumesFromImageTest-1601897198 None] Lock "cinder-994f7b5d-d407-473d-8337-0ca9d88c073a-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:12 devstack sudo[102047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dad1c44f-699e-4e74-a871-2f4ab089a0f1_46wcar41
Nov 05 03:57:12 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:12 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dad1c44f-699e-4e74-a871-2f4ab089a0f1_46wcar41" returned: 1 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dad1c44f-699e-4e74-a871-2f4ab089a0f1_46wcar41' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9b68db-157d-4d79-83cb-f251900ce8ef]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:12 devstack sudo[102051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD
Nov 05 03:57:12 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:12 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] dad1c44f-699e-4e74-a871-2f4ab089a0f1 was qcow2, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:12 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249
Nov 05 03:57:12 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:15 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249" returned: 0 in 2.624s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dad1c44f-699e-4e74-a871-2f4ab089a0f1_6ng3nipndevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:57:15 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Converted 112.00 MB image at 42.66 MB/s
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:15 devstack sudo[102084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 1G
Nov 05 03:57:15 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:15 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 1G" returned: 0 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Downloaded image dad1c44f-699e-4e74-a871-2f4ab089a0f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'metadata': {}}])) to volume 82c8f0f4-055d-4343-b197-b51e958b8249 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Temporary image dad1c44f-699e-4e74-a871-2f4ab089a0f1 for user 51cf8b06ca4041eab89449a6b7e0dd15 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Marking volume 82c8f0f4-055d-4343-b197-b51e958b8249 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Copying metadata from image dad1c44f-699e-4e74-a871-2f4ab089a0f1 to 82c8f0f4-055d-4343-b197-b51e958b8249. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Creating volume glance metadata for volume 82c8f0f4-055d-4343-b197-b51e958b8249 backed by image dad1c44f-699e-4e74-a871-2f4ab089a0f1 with: {'image_id': 'dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'image_name': 'tempest-scenario-img--873517575', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecca104-46bc-43be-a0ce-9fa29c73dc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c8f0f4-055d-4343-b197-b51e958b8249', 'volume_size': 1, 'image_id': 'dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--873517575', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b5d81635dc146c1b9383219befce640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dad1c44f-699e-4e74-a871-2f4ab089a0f1', 'created_at': datetime.datetime(2026, 11, 5, 2, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad1c44f-699e-4e74-a871-2f4ab089a0f1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab58db260>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7083530a-7e49-4da7-9dbc-1bcffba2f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Volume volume-82c8f0f4-055d-4343-b197-b51e958b8249 (82c8f0f4-055d-4343-b197-b51e958b8249): created successfully
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7083530a-7e49-4da7-9dbc-1bcffba2f428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Flow 'volume_create_manager' (c4be078d-10b2-436a-b7e6-a395621f26d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c0825cc4-c296-47dc-81ca-0816c73e0d2d tempest-TestInstancesWithCinderVolumes-1233871322 None] Created volume successfully.
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (ef36954f-74fd-4222-beef-c869fcc2db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83f01ea-cc2b-4038-97f9-639408a43f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83f01ea-cc2b-4038-97f9-639408a43f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-200869987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b69e426-157f-4042-b555-e8f78a94fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:17Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e97b1ef-c493-4155-8671-b6f3b9beffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e97b1ef-c493-4155-8671-b6f3b9beffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16809b56-d5ff-4c27-b2c3-fcfc0c32bfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16809b56-d5ff-4c27-b2c3-fcfc0c32bfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b69e426-157f-4042-b555-e8f78a94fe17', 'volume_name': 'volume-4b69e426-157f-4042-b555-e8f78a94fe17', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fec0faa-0738-40ed-95af-adad086be3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fec0faa-0738-40ed-95af-adad086be3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a59a855-936a-469b-9b5f-5f0cb3d554f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume 4b69e426-157f-4042-b555-e8f78a94fe17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b69e426-157f-4042-b555-e8f78a94fe17', 'volume_size': 1}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-200869987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b69e426-157f-4042-b555-e8f78a94fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:17Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Creating volume 4b69e426-157f-4042-b555-e8f78a94fe17 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:16 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:16 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17 1073741824
Nov 05 03:57:16 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:17 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17 1073741824" returned: 0 in 0.798s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:17 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17
Nov 05 03:57:17 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:18 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a59a855-936a-469b-9b5f-5f0cb3d554f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b69e426-157f-4042-b555-e8f78a94fe17', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e874a5b6-f31d-4044-8b6c-6e1c6278ca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume volume-4b69e426-157f-4042-b555-e8f78a94fe17 (4b69e426-157f-4042-b555-e8f78a94fe17): created successfully
Nov 05 03:57:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e874a5b6-f31d-4044-8b6c-6e1c6278ca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (ef36954f-74fd-4222-beef-c869fcc2db6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2cdf4311-2f7c-471d-84c5-a9689fe83812 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created volume successfully.
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (4eab7d7a-77fc-4784-8bd6-370483ec0d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3999bc-a72e-4030-bcc7-a7673ef82b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3999bc-a72e-4030-bcc7-a7673ef82b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237809820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d5f46d-14f3-4a50-be7e-1f87b3179d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:19Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0eacd8-1bbe-403f-b552-b299b4e2c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0eacd8-1bbe-403f-b552-b299b4e2c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4771f-0571-42b6-9e54-89bfbcbc2212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4771f-0571-42b6-9e54-89bfbcbc2212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d5f46d-14f3-4a50-be7e-1f87b3179d18', 'volume_name': 'volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b757a66-bfb5-48f8-af02-b9a2d0907496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b757a66-bfb5-48f8-af02-b9a2d0907496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaf831f-4346-4911-a6fb-8a0fa0db1245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume b3d5f46d-14f3-4a50-be7e-1f87b3179d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18', 'volume_size': 1}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237809820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d5f46d-14f3-4a50-be7e-1f87b3179d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:19Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Creating volume b3d5f46d-14f3-4a50-be7e-1f87b3179d18 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:19 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:19 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18 1073741824
Nov 05 03:57:19 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (fd92600b-c07b-4634-b163-cfe3b6551fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33992961-b1c6-4828-a819-804890c2c35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33992961-b1c6-4828-a819-804890c2c35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-156204535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db601de-c00f-404b-a7c0-852faa43ada5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:20Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb45e6c-f603-4cda-94e6-60af3d7adbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb45e6c-f603-4cda-94e6-60af3d7adbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e39d7aa-8081-4e65-9425-489185b0f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e39d7aa-8081-4e65-9425-489185b0f585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db601de-c00f-404b-a7c0-852faa43ada5', 'volume_name': 'volume-0db601de-c00f-404b-a7c0-852faa43ada5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbba6b90-8f08-4688-8654-5444b5fd6fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbba6b90-8f08-4688-8654-5444b5fd6fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caca135-25ba-4d5e-b4b6-fe03c085bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume 0db601de-c00f-404b-a7c0-852faa43ada5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db601de-c00f-404b-a7c0-852faa43ada5', 'volume_size': 1}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:20 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18 1073741824" returned: 0 in 0.999s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:20 devstack sudo[102178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18
Nov 05 03:57:20 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:21 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18" returned: 0 in 0.604s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-156204535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db601de-c00f-404b-a7c0-852faa43ada5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:20Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Creating volume 0db601de-c00f-404b-a7c0-852faa43ada5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:21 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5 1073741824
Nov 05 03:57:21 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (e3119fc2-1a70-4efa-a42f-b0ad5806081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a7f864-ddd6-4157-b23a-2945561a70c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaf831f-4346-4911-a6fb-8a0fa0db1245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7941d277-53bf-4d29-8680-17e5fbc41a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a7f864-ddd6-4157-b23a-2945561a70c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1786365193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dae10d-8652-4365-bcc0-62650c7ea0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:21Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a40c6b0-d4a2-4a01-8070-0a2fb13307b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a40c6b0-d4a2-4a01-8070-0a2fb13307b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f2ea5e-b016-4d73-aeda-d89302de128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f2ea5e-b016-4d73-aeda-d89302de128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dae10d-8652-4365-bcc0-62650c7ea0d0', 'volume_name': 'volume-45dae10d-8652-4365-bcc0-62650c7ea0d0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a6696a-2c5b-4bf6-8225-a4f5fa2103e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a6696a-2c5b-4bf6-8225-a4f5fa2103e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53292653-fdfa-4047-ad24-7312800ace00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume 45dae10d-8652-4365-bcc0-62650c7ea0d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dae10d-8652-4365-bcc0-62650c7ea0d0', 'volume_size': 1}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18 (b3d5f46d-14f3-4a50-be7e-1f87b3179d18): created successfully
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7941d277-53bf-4d29-8680-17e5fbc41a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (4eab7d7a-77fc-4784-8bd6-370483ec0d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3a4fda6f-87db-4e22-8e01-6af8f246b935 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created volume successfully.
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:22 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (c0f992d5-3a5f-4e10-902f-16028f3d89df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece5ebba-483d-469e-928b-669f76fd455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5 1073741824" returned: 0 in 1.108s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece5ebba-483d-469e-928b-669f76fd455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579289323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f50713-c229-4a31-9534-f177454d273a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:22Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354ebaf4-d5df-4b01-a79f-326dc711c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354ebaf4-d5df-4b01-a79f-326dc711c40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e77c96a-78dd-428e-a685-9fed006c9b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e77c96a-78dd-428e-a685-9fed006c9b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f50713-c229-4a31-9534-f177454d273a', 'volume_name': 'volume-57f50713-c229-4a31-9534-f177454d273a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5339ea7d-dd1c-4a13-ae95-2d15dfb12a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5339ea7d-dd1c-4a13-ae95-2d15dfb12a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296c8e2c-afc4-4e26-971a-3aa25dfec1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume 57f50713-c229-4a31-9534-f177454d273a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f50713-c229-4a31-9534-f177454d273a', 'volume_size': 1}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-0af0f85b-98ba-4dde-8c83-ba042d747bf9 req-2e0eb52e-a868-4bfe-bff1-71f41ce79834 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:22 devstack sudo[102195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5
Nov 05 03:57:22 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:23 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1786365193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dae10d-8652-4365-bcc0-62650c7ea0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:21Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Creating volume 45dae10d-8652-4365-bcc0-62650c7ea0d0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:23 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caca135-25ba-4d5e-b4b6-fe03c085bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db601de-c00f-404b-a7c0-852faa43ada5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b27950-93cc-48c0-83a4-8300c9759f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0 1073741824
Nov 05 03:57:23 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume volume-0db601de-c00f-404b-a7c0-852faa43ada5 (0db601de-c00f-404b-a7c0-852faa43ada5): created successfully
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b27950-93cc-48c0-83a4-8300c9759f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (fd92600b-c07b-4634-b163-cfe3b6551fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (08832665-9a9d-47bc-8a3a-33945cb678f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d110e54-7967-471e-8c26-1d2464dbef1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d110e54-7967-471e-8c26-1d2464dbef1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204243939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34565f40-96ea-4557-b7ae-c9cfc550e467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:23Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc40ca7-0e22-4761-9cd7-95e30c075a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc40ca7-0e22-4761-9cd7-95e30c075a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f1c414-b8be-45b5-83ca-4b2e8c790caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f1c414-b8be-45b5-83ca-4b2e8c790caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34565f40-96ea-4557-b7ae-c9cfc550e467', 'volume_name': 'volume-34565f40-96ea-4557-b7ae-c9cfc550e467', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e399f-dc68-4e1a-8898-b779fac90818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e399f-dc68-4e1a-8898-b779fac90818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de60755-9d53-44d0-b543-58d53b10c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume 34565f40-96ea-4557-b7ae-c9cfc550e467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34565f40-96ea-4557-b7ae-c9cfc550e467', 'volume_size': 1}
Nov 05 03:57:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2cac01c3-0f1c-40be-ab0f-0923ac8995dc tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created volume successfully.
Nov 05 03:57:24 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0 1073741824" returned: 0 in 0.771s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:24 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0
Nov 05 03:57:24 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:24 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579289323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f50713-c229-4a31-9534-f177454d273a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:22Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Creating volume 57f50713-c229-4a31-9534-f177454d273a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:24 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53292653-fdfa-4047-ad24-7312800ace00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dae10d-8652-4365-bcc0-62650c7ea0d0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:24 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a 1073741824
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66483dfb-aac3-419d-b040-8f54ff314691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:24 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume volume-45dae10d-8652-4365-bcc0-62650c7ea0d0 (45dae10d-8652-4365-bcc0-62650c7ea0d0): created successfully
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66483dfb-aac3-419d-b040-8f54ff314691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (e3119fc2-1a70-4efa-a42f-b0ad5806081a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-25a107fe-8eb7-4f95-b967-8f1d1805e87e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created volume successfully.
Nov 05 03:57:25 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a 1073741824" returned: 0 in 0.638s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:25 devstack sudo[102215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a
Nov 05 03:57:25 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:25 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a" returned: 0 in 0.526s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-0af0f85b-98ba-4dde-8c83-ba042d747bf9 req-2e0eb52e-a868-4bfe-bff1-71f41ce79834 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.984s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296c8e2c-afc4-4e26-971a-3aa25dfec1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f50713-c229-4a31-9534-f177454d273a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baaf9dc-6fce-4098-878a-9375b1b4b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-0af0f85b-98ba-4dde-8c83-ba042d747bf9 req-2e0eb52e-a868-4bfe-bff1-71f41ce79834 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204243939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34565f40-96ea-4557-b7ae-c9cfc550e467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef243ff29b4cf685d52134fd81099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:23Z,use_quota=True,user_id='dd7589cd567548b6b94316bf05bb4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Creating volume 34565f40-96ea-4557-b7ae-c9cfc550e467 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:25 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume volume-57f50713-c229-4a31-9534-f177454d273a (57f50713-c229-4a31-9534-f177454d273a): created successfully
Nov 05 03:57:25 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467 1073741824
Nov 05 03:57:25 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baaf9dc-6fce-4098-878a-9375b1b4b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (c0f992d5-3a5f-4e10-902f-16028f3d89df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a0ebe0de-afa6-4ae8-a9c3-3588c00e890e tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created volume successfully.
Nov 05 03:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-0af0f85b-98ba-4dde-8c83-ba042d747bf9 req-2e0eb52e-a868-4bfe-bff1-71f41ce79834 tempest-TestInstancesWithCinderVolumes-1233871322 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-82c8f0f4-055d-4343-b197-b51e958b8249', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5c8bd8b-8932-4757-8075-c40e99f40f9c', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:57:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-0af0f85b-98ba-4dde-8c83-ba042d747bf9 req-2e0eb52e-a868-4bfe-bff1-71f41ce79834 tempest-TestInstancesWithCinderVolumes-1233871322 None] attachment_update completed successfully.
Nov 05 03:57:26 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467 1073741824" returned: 0 in 0.655s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:26 devstack sudo[102250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467
Nov 05 03:57:26 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:26 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467" returned: 0 in 0.469s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de60755-9d53-44d0-b543-58d53b10c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34565f40-96ea-4557-b7ae-c9cfc550e467', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f292b258-9720-48ca-b4c8-ae40b5ee230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Volume volume-34565f40-96ea-4557-b7ae-c9cfc550e467 (34565f40-96ea-4557-b7ae-c9cfc550e467): created successfully
Nov 05 03:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f292b258-9720-48ca-b4c8-ae40b5ee230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Flow 'volume_create_manager' (08832665-9a9d-47bc-8a3a-33945cb678f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b0fe643a-0763-493a-a565-3c4b87c97ca4 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created volume successfully.
Nov 05 03:57:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-34565f40-96ea-4557-b7ae-c9cfc550e467-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-34565f40-96ea-4557-b7ae-c9cfc550e467-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-quobyte-34565f40-96ea-4557-b7ae-c9cfc550e467" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-34565f40-96ea-4557-b7ae-c9cfc550e467" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[208eca04-2078-4a9f-bcce-1f6fc78e0a51]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:28 devstack sudo[102706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467
Nov 05 03:57:28 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:28 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467" returned: 0 in 0.524s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:28 devstack sudo[102712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467
Nov 05 03:57:28 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:29 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-34565f40-96ea-4557-b7ae-c9cfc550e467" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-34565f40-96ea-4557-b7ae-c9cfc550e467" released by "delete_volume" :: held 0.913s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created reservations ['7bd52ebf-ea11-48f0-b0e5-7299e02ba770', '4b1c6ea8-8352-45d6-91fb-814c944e025a', '0f90d5d9-6a65-4d32-bfbb-9a981c72432c', '1e451289-9582-4e4d-80ce-f63a52c87d83'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:29 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:29 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:29 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Deleted volume successfully.
Nov 05 03:57:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-821606f6-d704-4c88-a48e-a40bd2f3d4c2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-34565f40-96ea-4557-b7ae-c9cfc550e467-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-57f50713-c229-4a31-9534-f177454d273a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-57f50713-c229-4a31-9534-f177454d273a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-quobyte-57f50713-c229-4a31-9534-f177454d273a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-57f50713-c229-4a31-9534-f177454d273a" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa7dcf8-fbc6-4bb8-8581-8d712dc5c25c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:30 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a
Nov 05 03:57:30 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:31 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a" returned: 0 in 0.665s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:31 devstack sudo[102726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a
Nov 05 03:57:31 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:31 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57f50713-c229-4a31-9534-f177454d273a" returned: 0 in 0.363s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-57f50713-c229-4a31-9534-f177454d273a" released by "delete_volume" :: held 1.102s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created reservations ['e4a9efdb-095c-422f-a27e-27d03b91768e', 'c2b8e8d4-462b-45e9-b200-7370b5a1a04e', '6ccafd4b-5162-48f6-a016-4ea113d6d561', '219b9a19-fea4-406d-83e2-8750a780a568'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:31 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:31 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:32 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Deleted volume successfully.
Nov 05 03:57:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-40631c20-7e9e-44b3-9bc9-0ba9d2835994 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-57f50713-c229-4a31-9534-f177454d273a-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-45dae10d-8652-4365-bcc0-62650c7ea0d0-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-45dae10d-8652-4365-bcc0-62650c7ea0d0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-quobyte-45dae10d-8652-4365-bcc0-62650c7ea0d0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-45dae10d-8652-4365-bcc0-62650c7ea0d0" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[77960ac8-4869-424a-9ac0-21bb240f8ea2]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:33 devstack sudo[102774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0
Nov 05 03:57:33 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:33 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:33 devstack sudo[102780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0
Nov 05 03:57:33 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:33 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-45dae10d-8652-4365-bcc0-62650c7ea0d0" returned: 0 in 0.369s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-45dae10d-8652-4365-bcc0-62650c7ea0d0" released by "delete_volume" :: held 0.916s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created reservations ['9970bbf3-26a4-41e1-a9d1-3d78ec47bd10', '688302a6-ff2a-455f-aa4c-6f1fda3cf17b', '8530a4d2-1323-4c58-8cac-af33219c00ff', '4b24dad2-2181-49c0-a755-7940e714dd9b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:34 devstack sudo[102783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:34 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:34 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.337s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Deleted volume successfully.
Nov 05 03:57:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-77644a1f-2ed9-4fe4-8fab-c571bb0cab7a tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-45dae10d-8652-4365-bcc0-62650c7ea0d0-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-0db601de-c00f-404b-a7c0-852faa43ada5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-0db601de-c00f-404b-a7c0-852faa43ada5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-quobyte-0db601de-c00f-404b-a7c0-852faa43ada5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-0db601de-c00f-404b-a7c0-852faa43ada5" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a2bc8d-a2af-4dda-8a08-a30249bf90fd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:35 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5
Nov 05 03:57:35 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:35 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:35 devstack sudo[102797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5
Nov 05 03:57:35 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:36 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0db601de-c00f-404b-a7c0-852faa43ada5" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-0db601de-c00f-404b-a7c0-852faa43ada5" released by "delete_volume" :: held 0.765s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created reservations ['a61c8e20-2859-445e-800e-2e57a63e9ceb', '0a3236d4-a952-43a8-bbd2-e1e3ac88e94d', '362245ff-7856-42bc-8a11-5a6b57756997', '7700e3b0-614d-41d1-bf03-137ea395e009'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:36 devstack sudo[102800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:36 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-b3d5f46d-14f3-4a50-be7e-1f87b3179d18-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-b3d5f46d-14f3-4a50-be7e-1f87b3179d18-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:36 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Deleted volume successfully.
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-quobyte-b3d5f46d-14f3-4a50-be7e-1f87b3179d18" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99e4827c-fc34-46fc-9e23-7ead3be03d42 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-0db601de-c00f-404b-a7c0-852faa43ada5-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-b3d5f46d-14f3-4a50-be7e-1f87b3179d18" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdcfc12-d913-4090-87a2-d929bd9ba4ce]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:36 devstack sudo[102803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18
Nov 05 03:57:36 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:37 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18" returned: 0 in 0.451s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:37 devstack sudo[102810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18
Nov 05 03:57:37 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:37 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b3d5f46d-14f3-4a50-be7e-1f87b3179d18" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-b3d5f46d-14f3-4a50-be7e-1f87b3179d18" released by "delete_volume" :: held 0.819s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created reservations ['7ad1b945-b975-4d4d-bfa2-bc0da365e622', '59fd7f50-c12e-47f8-9a97-3e11fa9ab87d', 'fa23ef87-f619-4e3a-a370-e550754f4e76', '1fa65436-d413-41b1-8c47-dfd0e89b50b3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:37 devstack sudo[102813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:37 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-4b69e426-157f-4042-b555-e8f78a94fe17-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-4b69e426-157f-4042-b555-e8f78a94fe17-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "cinder-quobyte-4b69e426-157f-4042-b555-e8f78a94fe17" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-4b69e426-157f-4042-b555-e8f78a94fe17" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[52996160-a3a6-4de4-9b70-492333754629]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:38 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Deleted volume successfully.
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-32fbd276-67fb-4b91-b0ff-a033c00bfde6 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-b3d5f46d-14f3-4a50-be7e-1f87b3179d18-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:38 devstack sudo[102815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17
Nov 05 03:57:38 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:38 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:38 devstack sudo[102821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17
Nov 05 03:57:38 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:38 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b69e426-157f-4042-b555-e8f78a94fe17" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-quobyte-4b69e426-157f-4042-b555-e8f78a94fe17" released by "delete_volume" :: held 0.682s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Created reservations ['dc7d5b25-bc91-4314-bf89-b6659b8311d1', '1789e316-e695-4d5e-bf1e-d2457beed1f4', '26e22993-4ba7-458e-b8a8-f440db933ecf', '59aeb263-1411-4888-a71f-35ac2b6c9c19'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:38 devstack sudo[102824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:38 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:38 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.244s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:38 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Deleted volume successfully.
Nov 05 03:57:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5897e517-a9c9-4d39-8d85-7386e39f75b2 tempest-CreateVolumesFromSourceVolumeTest-1820132758 None] Lock "cinder-4b69e426-157f-4042-b555-e8f78a94fe17-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:44 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Flow 'volume_create_manager' (e7f2c0a3-8cbc-4078-be54-57eb06af7bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ac686f-e6a2-464f-839d-345dbc4c4346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ac686f-e6a2-464f-839d-345dbc4c4346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-665569584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5933fde-2bbc-4646-bb9f-d4f957e5e573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf14ef56bb540fdb2956542dca6598d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:45Z,use_quota=True,user_id='a514437c2ea541968ed62fa2c0e6a7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dbb746-3ed5-4b6a-93fc-ac0e12a22741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dbb746-3ed5-4b6a-93fc-ac0e12a22741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2736f7d-f2c9-4b94-b337-8a834bd2857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2736f7d-f2c9-4b94-b337-8a834bd2857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5933fde-2bbc-4646-bb9f-d4f957e5e573', 'volume_name': 'volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c2442a-e3e4-4aec-a425-7926e733e8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c2442a-e3e4-4aec-a425-7926e733e8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c9028-1c40-4101-83c6-b915d1a5add3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Volume a5933fde-2bbc-4646-bb9f-d4f957e5e573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573', 'volume_size': 1}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-665569584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5933fde-2bbc-4646-bb9f-d4f957e5e573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf14ef56bb540fdb2956542dca6598d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:45Z,use_quota=True,user_id='a514437c2ea541968ed62fa2c0e6a7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Creating volume a5933fde-2bbc-4646-bb9f-d4f957e5e573 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:45 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:45 devstack sudo[102870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573 1073741824
Nov 05 03:57:45 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:45 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573 1073741824" returned: 0 in 0.620s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:45 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573
Nov 05 03:57:45 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:46 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c9028-1c40-4101-83c6-b915d1a5add3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d42a6cf-9bc8-44fe-a9eb-60c5f8551b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Volume volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573 (a5933fde-2bbc-4646-bb9f-d4f957e5e573): created successfully
Nov 05 03:57:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d42a6cf-9bc8-44fe-a9eb-60c5f8551b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Flow 'volume_create_manager' (e7f2c0a3-8cbc-4078-be54-57eb06af7bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8c8f392f-41ea-404b-bac6-e74ad88dacb0 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Created volume successfully.
Nov 05 03:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7aa48d93-08ac-425c-939c-a09bf875468e req-33ef6418-d240-491c-981a-626f09a5d763 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7aa48d93-08ac-425c-939c-a09bf875468e req-33ef6418-d240-491c-981a-626f09a5d763 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7aa48d93-08ac-425c-939c-a09bf875468e req-33ef6418-d240-491c-981a-626f09a5d763 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7aa48d93-08ac-425c-939c-a09bf875468e req-33ef6418-d240-491c-981a-626f09a5d763 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ece4dfdd-ff61-4066-b466-429cf81c8ffd', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:57:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7aa48d93-08ac-425c-939c-a09bf875468e req-33ef6418-d240-491c-981a-626f09a5d763 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] attachment_update completed successfully.
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (8f510c23-78e8-4fc8-8686-80ddc377fdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67768eda-3c47-469d-8842-6406b1cd93c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67768eda-3c47-469d-8842-6406b1cd93c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788161179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01987702-42be-4f35-b6bb-4da83f285653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:48Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af13b2f-0091-4aa4-b4bb-84ff723a78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af13b2f-0091-4aa4-b4bb-84ff723a78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94904be8-3239-423e-9c46-e954dc82d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94904be8-3239-423e-9c46-e954dc82d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01987702-42be-4f35-b6bb-4da83f285653', 'volume_name': 'volume-01987702-42be-4f35-b6bb-4da83f285653', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86741e-d25c-4654-a4b1-af16079f97f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86741e-d25c-4654-a4b1-af16079f97f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b37d29a-e8b5-4295-a164-3cc598ebf5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Volume 01987702-42be-4f35-b6bb-4da83f285653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01987702-42be-4f35-b6bb-4da83f285653', 'volume_size': 1}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788161179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01987702-42be-4f35-b6bb-4da83f285653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:48Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Creating volume 01987702-42be-4f35-b6bb-4da83f285653 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:48 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:48 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653 1073741824
Nov 05 03:57:48 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:48 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653 1073741824" returned: 0 in 0.407s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:48 devstack sudo[102932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653
Nov 05 03:57:48 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:49 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b37d29a-e8b5-4295-a164-3cc598ebf5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01987702-42be-4f35-b6bb-4da83f285653', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b492866b-634a-4988-92be-56ada203925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Volume volume-01987702-42be-4f35-b6bb-4da83f285653 (01987702-42be-4f35-b6bb-4da83f285653): created successfully
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b492866b-634a-4988-92be-56ada203925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (8f510c23-78e8-4fc8-8686-80ddc377fdad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cc51ad10-6b00-4050-848f-4ae35ebcd4f3 tempest-ProjectReaderTests-1559351871 None] Created volume successfully.
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-01987702-42be-4f35-b6bb-4da83f285653-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Lock "cinder-01987702-42be-4f35-b6bb-4da83f285653-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-quobyte-01987702-42be-4f35-b6bb-4da83f285653" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-01987702-42be-4f35-b6bb-4da83f285653" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a3167b-3f77-4205-8a0d-81ce84714a38]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:49 devstack sudo[102944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653
Nov 05 03:57:49 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-0e66a03b-c6c0-4c94-bc28-eba350bcbe4e req-93120ea5-3e4a-4469-b969-cc87bb56f0e4 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Terminate volume connection completed successfully.
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-0e66a03b-c6c0-4c94-bc28-eba350bcbe4e req-93120ea5-3e4a-4469-b969-cc87bb56f0e4 tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Deleting attachment ece4dfdd-ff61-4066-b466-429cf81c8ffd. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:57:50 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653" returned: 0 in 0.387s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:50 devstack sudo[102951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653
Nov 05 03:57:50 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:50 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-01987702-42be-4f35-b6bb-4da83f285653" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-01987702-42be-4f35-b6bb-4da83f285653" released by "delete_volume" :: held 0.707s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Created reservations ['5e3c9af2-93c7-4716-8e8e-d17618f869fe', '40bc39b1-daba-4a23-958d-6aa16271c6e7', 'f904d4f9-4459-479e-820f-011694c3adcc', 'd8b99725-3599-482a-b9c4-759ef55fbd02'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:50 devstack sudo[102954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:50 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:50 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Deleted volume successfully.
Nov 05 03:57:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abe93689-d295-4581-8f4a-22c0ddfd85df tempest-ProjectReaderTests-1559351871 None] Lock "cinder-01987702-42be-4f35-b6bb-4da83f285653-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Acquiring lock "cinder-a5933fde-2bbc-4646-bb9f-d4f957e5e573-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "cinder-a5933fde-2bbc-4646-bb9f-d4f957e5e573-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Acquiring lock "cinder-quobyte-a5933fde-2bbc-4646-bb9f-d4f957e5e573" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "cinder-quobyte-a5933fde-2bbc-4646-bb9f-d4f957e5e573" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[96304521-3568-4268-bcc4-0a8c44a3b01d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:51 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573
Nov 05 03:57:51 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (5089c0db-9ebb-41f7-abdf-782d5025f99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b97ed9-d94f-4680-9c20-55eca6fa3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b97ed9-d94f-4680-9c20-55eca6fa3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344205291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6406b6c8-727c-45ae-b167-830f65e50271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:51Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2affaf9-2a97-47a6-9a24-eeeac7202509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2affaf9-2a97-47a6-9a24-eeeac7202509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed54b58-6aa2-4c44-b821-e752c025938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed54b58-6aa2-4c44-b821-e752c025938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6406b6c8-727c-45ae-b167-830f65e50271', 'volume_name': 'volume-6406b6c8-727c-45ae-b167-830f65e50271', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561bd609-79c2-4729-add2-49475ea2b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561bd609-79c2-4729-add2-49475ea2b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6185a3b5-fc8a-44ba-8e4c-2c1d4d992a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Volume 6406b6c8-727c-45ae-b167-830f65e50271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6406b6c8-727c-45ae-b167-830f65e50271', 'volume_size': 1}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344205291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6406b6c8-727c-45ae-b167-830f65e50271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:51Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Creating volume 6406b6c8-727c-45ae-b167-830f65e50271 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:51 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:51 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271 1073741824
Nov 05 03:57:51 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:51 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573" returned: 0 in 0.360s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:51 devstack sudo[102964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573
Nov 05 03:57:51 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:51 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271 1073741824" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:51 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a5933fde-2bbc-4646-bb9f-d4f957e5e573" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "cinder-quobyte-a5933fde-2bbc-4646-bb9f-d4f957e5e573" released by "delete_volume" :: held 0.677s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:51 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271
Nov 05 03:57:51 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Created reservations ['ef130e52-6d25-4f92-8c29-6c5c1481fced', '3cb02e67-a9f9-4480-8016-1bf6a2b8c9c4', '0c573d74-7469-4d07-b609-3c5ca138c7cd', 'eb24275f-7515-469c-889f-ec08305325db'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:52 devstack sudo[102972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:52 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:52 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271" returned: 0 in 0.244s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6185a3b5-fc8a-44ba-8e4c-2c1d4d992a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6406b6c8-727c-45ae-b167-830f65e50271', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a227fd9-ee33-4cc5-aaf4-4e8db44a9738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Volume volume-6406b6c8-727c-45ae-b167-830f65e50271 (6406b6c8-727c-45ae-b167-830f65e50271): created successfully
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a227fd9-ee33-4cc5-aaf4-4e8db44a9738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (5089c0db-9ebb-41f7-abdf-782d5025f99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f27337a0-9b30-4220-9146-d7a7f61233a6 tempest-ProjectReaderTests-1559351871 None] Created volume successfully.
Nov 05 03:57:52 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Deleted volume successfully.
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7288a563-07bd-4036-931e-6737705baa9c tempest-TestServerVolumeAttachScenarioOldVersion-690371659 None] Lock "cinder-a5933fde-2bbc-4646-bb9f-d4f957e5e573-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-6406b6c8-727c-45ae-b167-830f65e50271-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-6406b6c8-727c-45ae-b167-830f65e50271-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-quobyte-6406b6c8-727c-45ae-b167-830f65e50271" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-6406b6c8-727c-45ae-b167-830f65e50271" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5a243-3152-49d9-b402-2e55c4c7a92d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:52 devstack sudo[102979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271
Nov 05 03:57:52 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:53 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:53 devstack sudo[103003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271
Nov 05 03:57:53 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:53 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6406b6c8-727c-45ae-b167-830f65e50271" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-6406b6c8-727c-45ae-b167-830f65e50271" released by "delete_volume" :: held 0.856s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Created reservations ['8b1b46ee-6237-442e-93c9-6559204f859d', '843ff78c-c1f9-4055-8a4c-919df9affa27', 'db056e08-ffdf-4511-b95d-a0f3a8b9d4b1', 'f1ae3ed5-ffd6-4138-8049-71b0e88dab96'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:53 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:53 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:54 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.392s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Deleted volume successfully.
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=135,cinder:UPDATE=161,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e8d0f8a0-040d-4dfb-9bdb-8482a445a2c6 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-6406b6c8-727c-45ae-b167-830f65e50271-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=127,cinder:UPDATE=174,cinder:DELETE=18,cinder:INSERT=39 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (716f9fca-4ac6-4cc5-aba7-79ece0611bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e653878-b8f0-4eb6-95a5-2b558a6bd32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e653878-b8f0-4eb6-95a5-2b558a6bd32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055676132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1b71d6-fd94-42c2-8b4a-3e327f314907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:54Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88424f16-4836-4d06-8d3c-b6ee177070ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88424f16-4836-4d06-8d3c-b6ee177070ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754f2b41-282f-4486-9af2-fa99dd40d7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754f2b41-282f-4486-9af2-fa99dd40d7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e1b71d6-fd94-42c2-8b4a-3e327f314907', 'volume_name': 'volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3953139-25e5-467a-87b2-e9827d97e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3953139-25e5-467a-87b2-e9827d97e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d7c61f-5ca0-4acb-a490-ea7f711022df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Volume 3e1b71d6-fd94-42c2-8b4a-3e327f314907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907', 'volume_size': 1}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055676132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1b71d6-fd94-42c2-8b4a-3e327f314907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:54Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Creating volume 3e1b71d6-fd94-42c2-8b4a-3e327f314907 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:54 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:54 devstack sudo[103013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907 1073741824
Nov 05 03:57:54 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:55 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907 1073741824" returned: 0 in 0.564s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:55 devstack sudo[103019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907
Nov 05 03:57:55 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:55 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d7c61f-5ca0-4acb-a490-ea7f711022df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2d93f7-4f22-4ed4-be99-af269be54409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Volume volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907 (3e1b71d6-fd94-42c2-8b4a-3e327f314907): created successfully
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2d93f7-4f22-4ed4-be99-af269be54409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (716f9fca-4ac6-4cc5-aba7-79ece0611bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-69232a23-47a1-474f-a130-26e095f648cd tempest-ProjectReaderTests-1559351871 None] Created volume successfully.
Nov 05 03:57:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-3e1b71d6-fd94-42c2-8b4a-3e327f314907-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Lock "cinder-3e1b71d6-fd94-42c2-8b4a-3e327f314907-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-quobyte-3e1b71d6-fd94-42c2-8b4a-3e327f314907" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-3e1b71d6-fd94-42c2-8b4a-3e327f314907" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b36c9d8-ae2f-4f78-b7cd-8ee759d5217b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:56 devstack sudo[103022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907
Nov 05 03:57:56 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:57 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:57 devstack sudo[103031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907
Nov 05 03:57:57 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:57 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3e1b71d6-fd94-42c2-8b4a-3e327f314907" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-3e1b71d6-fd94-42c2-8b4a-3e327f314907" released by "delete_volume" :: held 0.881s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Created reservations ['59edf3ae-2fc8-47cc-99e5-3f6fa0176600', 'ecdcfa8c-7913-4153-9ed6-a6224b4a48ab', '244ae0eb-d44f-4e55-ba3b-3702515057e5', '58bd4fdb-016c-4113-8f19-51c06b4f3a08'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:57 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:57:57 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-8faec81d-33e8-4622-8cec-27ae9d177684 req-a02340fa-d8ab-4ff3-af40-5cec184636d6 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-8faec81d-33e8-4622-8cec-27ae9d177684 req-a02340fa-d8ab-4ff3-af40-5cec184636d6 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-8faec81d-33e8-4622-8cec-27ae9d177684 req-a02340fa-d8ab-4ff3-af40-5cec184636d6 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-8faec81d-33e8-4622-8cec-27ae9d177684 req-a02340fa-d8ab-4ff3-af40-5cec184636d6 tempest-TestInstancesWithCinderVolumes-1233871322 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-7a7d1956-358e-4553-9229-2978eaeca15c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3ddfc01-40ef-48f3-87e6-bb78178296bc', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:57:58 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Deleted volume successfully.
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-785bbfc4-7110-4d8f-9cdb-d9515b862d6e tempest-ProjectReaderTests-1559351871 None] Lock "cinder-3e1b71d6-fd94-42c2-8b4a-3e327f314907-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-8faec81d-33e8-4622-8cec-27ae9d177684 req-a02340fa-d8ab-4ff3-af40-5cec184636d6 tempest-TestInstancesWithCinderVolumes-1233871322 None] attachment_update completed successfully.
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (d46d45b7-b0d2-4962-8881-a3c95f74b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02701d57-84f9-4ccb-b789-742d045d8960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02701d57-84f9-4ccb-b789-742d045d8960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469799262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a5e5ce-6f33-4d53-adad-bc9e14848ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:58Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b89c73f-92f3-4cf2-80ae-7ead1ae7f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b89c73f-92f3-4cf2-80ae-7ead1ae7f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af27a7d-4540-4c99-b13d-9112673c873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af27a7d-4540-4c99-b13d-9112673c873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a5e5ce-6f33-4d53-adad-bc9e14848ba2', 'volume_name': 'volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19b7ea9-3031-4c87-9700-d7bd71c9f10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19b7ea9-3031-4c87-9700-d7bd71c9f10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801f50ca-a13f-44ba-a84c-be927380eb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Volume 17a5e5ce-6f33-4d53-adad-bc9e14848ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2', 'volume_size': 1}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469799262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a5e5ce-6f33-4d53-adad-bc9e14848ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeae88a6f1a4ea4aca02b1e03eac78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:58Z,use_quota=True,user_id='08a8c392949d40e9af1a5ac555b7296e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Creating volume 17a5e5ce-6f33-4d53-adad-bc9e14848ba2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:58 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:57:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:58 devstack sudo[103052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2 1073741824
Nov 05 03:57:58 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:59 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2 1073741824" returned: 0 in 0.516s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:59 devstack sudo[103058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2
Nov 05 03:57:59 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:59 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801f50ca-a13f-44ba-a84c-be927380eb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d257b04d-301a-4029-ad17-d7baebad6600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Volume volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2 (17a5e5ce-6f33-4d53-adad-bc9e14848ba2): created successfully
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d257b04d-301a-4029-ad17-d7baebad6600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Flow 'volume_create_manager' (d46d45b7-b0d2-4962-8881-a3c95f74b32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1416cf57-89af-4806-9c29-a53f66f8a3a5 tempest-ProjectReaderTests-1559351871 None] Created volume successfully.
Nov 05 03:58:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-17a5e5ce-6f33-4d53-adad-bc9e14848ba2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-17a5e5ce-6f33-4d53-adad-bc9e14848ba2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "cinder-quobyte-17a5e5ce-6f33-4d53-adad-bc9e14848ba2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-17a5e5ce-6f33-4d53-adad-bc9e14848ba2" acquired by "delete_volume" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d6269-b4a9-47f2-9b50-618955dfc82d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:00 devstack sudo[103071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2
Nov 05 03:58:00 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:01 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2" returned: 0 in 0.505s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:01 devstack sudo[103084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2
Nov 05 03:58:01 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-548ebcfe-6cf8-47b1-943f-be124f1ab215 req-3e4d4d0c-dd3b-4671-955c-b1079311d78b tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-548ebcfe-6cf8-47b1-943f-be124f1ab215 req-3e4d4d0c-dd3b-4671-955c-b1079311d78b tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-548ebcfe-6cf8-47b1-943f-be124f1ab215 req-3e4d4d0c-dd3b-4671-955c-b1079311d78b tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-548ebcfe-6cf8-47b1-943f-be124f1ab215 req-3e4d4d0c-dd3b-4671-955c-b1079311d78b tempest-TestInstancesWithCinderVolumes-1233871322 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-b899bd26-91ca-475f-ac29-ad67622d3d7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '292cc376-929a-423d-85a5-e8d09f238ba7', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:58:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-548ebcfe-6cf8-47b1-943f-be124f1ab215 req-3e4d4d0c-dd3b-4671-955c-b1079311d78b tempest-TestInstancesWithCinderVolumes-1233871322 None] attachment_update completed successfully.
Nov 05 03:58:01 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17a5e5ce-6f33-4d53-adad-bc9e14848ba2" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-quobyte-17a5e5ce-6f33-4d53-adad-bc9e14848ba2" released by "delete_volume" :: held 0.944s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Created reservations ['5252402a-e443-42a8-9e86-ec5b28c07ca7', '6ec07e53-4c66-4093-afc5-b64641df75ff', '7c2afe83-a2bb-4952-8241-273c8f6cc29b', 'c3161bde-d4db-4ae9-8618-3dc83e313ec2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:01 devstack sudo[103090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:58:01 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:02 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:02 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Deleted volume successfully.
Nov 05 03:58:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b7c78bdf-3d66-4666-921f-42524d0091a1 tempest-ProjectReaderTests-1559351871 None] Lock "cinder-17a5e5ce-6f33-4d53-adad-bc9e14848ba2-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-f4fed3aa-a23d-4e3e-903e-e540d18da750 req-cca43d6e-deef-48b3-b6e6-7f334f604e62 tempest-TestInstancesWithCinderVolumes-1233871322 None] Terminate volume connection completed successfully.
Nov 05 03:58:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-f4fed3aa-a23d-4e3e-903e-e540d18da750 req-cca43d6e-deef-48b3-b6e6-7f334f604e62 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deleting attachment b3ddfc01-40ef-48f3-87e6-bb78178296bc. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "cinder-7a7d1956-358e-4553-9229-2978eaeca15c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-7a7d1956-358e-4553-9229-2978eaeca15c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "cinder-quobyte-7a7d1956-358e-4553-9229-2978eaeca15c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-quobyte-7a7d1956-358e-4553-9229-2978eaeca15c" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0330a000-da6b-467e-93ae-713af724d6b7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:08 devstack sudo[103134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c
Nov 05 03:58:08 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:08 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c" returned: 0 in 0.445s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:08 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c
Nov 05 03:58:08 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:09 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7a7d1956-358e-4553-9229-2978eaeca15c" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-quobyte-7a7d1956-358e-4553-9229-2978eaeca15c" released by "delete_volume" :: held 0.793s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:09 devstack cinder-volume[87401]: WARNING cinder.quota [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957739360-1545639723 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957739360-1545639723, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:09 devstack cinder-volume[87401]: WARNING cinder.quota [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957739360-1545639723 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957739360-1545639723, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Created reservations ['b308208f-c67f-494f-a9f9-edea92916d5b', 'afa40fc6-8c1b-40b2-95cc-b133fb3ac90c', '0755e299-1686-4624-ac98-81ced6a04b73', '4612a0f5-da14-404c-ad98-60857b094e30'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:09 devstack sudo[103143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:58:09 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:09 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Deleted volume successfully.
Nov 05 03:58:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-db7db196-d75c-4778-b8f5-6d21b0e78c8c tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-7a7d1956-358e-4553-9229-2978eaeca15c-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:10 devstack sudo[103148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:58:10 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:10 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.253s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:58:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:58:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-51fcd6a1-ee2d-4ee8-80c1-ed81d53d9e53 req-656b48a8-25b8-4b18-b55e-4af9b8438c19 tempest-TestInstancesWithCinderVolumes-1233871322 None] Terminate volume connection completed successfully.
Nov 05 03:58:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-51fcd6a1-ee2d-4ee8-80c1-ed81d53d9e53 req-656b48a8-25b8-4b18-b55e-4af9b8438c19 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deleting attachment 292cc376-929a-423d-85a5-e8d09f238ba7. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "cinder-b899bd26-91ca-475f-ac29-ad67622d3d7d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-b899bd26-91ca-475f-ac29-ad67622d3d7d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "cinder-quobyte-b899bd26-91ca-475f-ac29-ad67622d3d7d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-quobyte-b899bd26-91ca-475f-ac29-ad67622d3d7d" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8d13a-e93f-48d0-a4cf-a193c9f03abb]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:13 devstack sudo[103171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d
Nov 05 03:58:13 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:13 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:13 devstack sudo[103177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d
Nov 05 03:58:13 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:14 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b899bd26-91ca-475f-ac29-ad67622d3d7d" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-quobyte-b899bd26-91ca-475f-ac29-ad67622d3d7d" released by "delete_volume" :: held 0.748s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:14 devstack cinder-volume[87401]: WARNING cinder.quota [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522864078-575340630 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522864078-575340630, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:14 devstack cinder-volume[87401]: WARNING cinder.quota [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522864078-575340630 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522864078-575340630, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Created reservations ['b9f12c5d-8351-4e88-b676-04f0064a7f87', '722d6a60-e7a8-49f3-9fac-566d925f9ae4', '3d23f1b4-c1f8-4a6b-b31f-65fd466ff6d7', '5f16a2cc-14cd-4c0b-95b5-df2d1fd3ab2d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:14 devstack sudo[103180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:58:14 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:14 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deleted volume successfully.
Nov 05 03:58:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62e987e1-eeed-436a-a81e-d1554e20faa3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-b899bd26-91ca-475f-ac29-ad67622d3d7d-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-3f44bef0-a8ee-4ad3-bf9c-a0e1838f020e req-6c61f911-626b-4b23-a21f-10ea939881e3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Terminate volume connection completed successfully.
Nov 05 03:58:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-3f44bef0-a8ee-4ad3-bf9c-a0e1838f020e req-6c61f911-626b-4b23-a21f-10ea939881e3 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deleting attachment c5c8bd8b-8932-4757-8075-c40e99f40f9c. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "cinder-82c8f0f4-055d-4343-b197-b51e958b8249-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-82c8f0f4-055d-4343-b197-b51e958b8249-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "cinder-quobyte-82c8f0f4-055d-4343-b197-b51e958b8249" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-quobyte-82c8f0f4-055d-4343-b197-b51e958b8249" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4608d47b-0342-4488-8407-b7b768517c10]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:19 devstack sudo[103212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249
Nov 05 03:58:19 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:19 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:19 devstack sudo[103217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249
Nov 05 03:58:19 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:20 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-82c8f0f4-055d-4343-b197-b51e958b8249" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-quobyte-82c8f0f4-055d-4343-b197-b51e958b8249" released by "delete_volume" :: held 0.708s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:20 devstack cinder-volume[87401]: WARNING cinder.quota [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462534360-918029141 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462534360-918029141, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:20 devstack cinder-volume[87401]: WARNING cinder.quota [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462534360-918029141 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462534360-918029141, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Created reservations ['94cbdcce-3460-4dd7-8a95-26ca9d7f0c22', '641bcf43-8054-4970-aab2-fdbe4980fca9', 'aa791ae8-87a6-43e6-95ed-ec3c4e43be31', '3540a449-609a-45aa-829f-72611b302cb5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:20 devstack sudo[103220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:58:20 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:20 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Deleted volume successfully.
Nov 05 03:58:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed36f46-b5e2-4a3d-81be-0e7ed5e311c2 tempest-TestInstancesWithCinderVolumes-1233871322 None] Lock "cinder-82c8f0f4-055d-4343-b197-b51e958b8249-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:30 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=55,cinder:SELECT=50,cinder:DELETE=2,cinder:INSERT=12 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:58:30 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=43,cinder:INSERT=10,cinder:SELECT=44,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Flow 'volume_create_manager' (c0ddd346-bf5a-474f-809c-e1c541e9d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42d3912-d5f8-4b3b-a055-e334a3a052e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42d3912-d5f8-4b3b-a055-e334a3a052e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-805152705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3950bffd-3e17-44d6-9665-ca682790e1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0031d51c994de6b9a44ea2cb419a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:37Z,use_quota=True,user_id='5b79f551c3844756b77ad8136b6e1aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253aa081-6fd7-440f-a9d5-c3cf836a310f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253aa081-6fd7-440f-a9d5-c3cf836a310f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3edd16-f71c-4750-8cce-4787e9274ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3edd16-f71c-4750-8cce-4787e9274ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3950bffd-3e17-44d6-9665-ca682790e1dc', 'volume_name': 'volume-3950bffd-3e17-44d6-9665-ca682790e1dc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96479e88-ea4c-4f4d-9929-fee1560e9d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96479e88-ea4c-4f4d-9929-fee1560e9d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced8f5df-1b7f-481b-9da6-70854a41b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Volume 3950bffd-3e17-44d6-9665-ca682790e1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3950bffd-3e17-44d6-9665-ca682790e1dc', 'volume_size': 1}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-805152705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3950bffd-3e17-44d6-9665-ca682790e1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0031d51c994de6b9a44ea2cb419a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:37Z,use_quota=True,user_id='5b79f551c3844756b77ad8136b6e1aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Creating volume 3950bffd-3e17-44d6-9665-ca682790e1dc {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:58:36 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:36 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc 1073741824
Nov 05 03:58:36 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Flow 'volume_create_manager' (79845113-c026-4627-b6f3-bf1f74957015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c467eab-7ccd-4bfc-bd51-2a4b90969bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:37 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c467eab-7ccd-4bfc-bd51-2a4b90969bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-438113281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f54b8bf-95a8-406e-b848-ec5afb2e03a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0031d51c994de6b9a44ea2cb419a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:37Z,use_quota=True,user_id='5b79f551c3844756b77ad8136b6e1aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1366489-5ee8-4992-805d-7967fe9b8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1366489-5ee8-4992-805d-7967fe9b8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b481ed3f-cfd8-4105-9f60-e6ccb7298684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b481ed3f-cfd8-4105-9f60-e6ccb7298684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f54b8bf-95a8-406e-b848-ec5afb2e03a6', 'volume_name': 'volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754583f4-59e8-489e-a4a4-fbcf22f3a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754583f4-59e8-489e-a4a4-fbcf22f3a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff142e01-db75-48a0-b794-ed2c4ac454e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Volume 0f54b8bf-95a8-406e-b848-ec5afb2e03a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6', 'volume_size': 1}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc 1073741824" returned: 0 in 0.718s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:37 devstack sudo[103241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc
Nov 05 03:58:37 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:37 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc" returned: 0 in 0.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-438113281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f54b8bf-95a8-406e-b848-ec5afb2e03a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0031d51c994de6b9a44ea2cb419a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:37Z,use_quota=True,user_id='5b79f551c3844756b77ad8136b6e1aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Creating volume 0f54b8bf-95a8-406e-b848-ec5afb2e03a6 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:58:37 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced8f5df-1b7f-481b-9da6-70854a41b73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3950bffd-3e17-44d6-9665-ca682790e1dc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab70e29b-7921-4728-b759-31b0d3d7bc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:38 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6 1073741824
Nov 05 03:58:38 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Volume volume-3950bffd-3e17-44d6-9665-ca682790e1dc (3950bffd-3e17-44d6-9665-ca682790e1dc): created successfully
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab70e29b-7921-4728-b759-31b0d3d7bc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Flow 'volume_create_manager' (c0ddd346-bf5a-474f-809c-e1c541e9d76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b175c3ea-d524-48a6-bd2f-2d99cadbc19a tempest-TestServerVolumeAttachmentScenario-729810210 None] Created volume successfully.
Nov 05 03:58:38 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6 1073741824" returned: 0 in 0.602s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:38 devstack sudo[103250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6
Nov 05 03:58:38 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:38 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff142e01-db75-48a0-b794-ed2c4ac454e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194f8d42-ab52-46b1-a092-640b498e7e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Volume volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6 (0f54b8bf-95a8-406e-b848-ec5afb2e03a6): created successfully
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194f8d42-ab52-46b1-a092-640b498e7e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Flow 'volume_create_manager' (79845113-c026-4627-b6f3-bf1f74957015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a0827070-71a8-4304-acc0-346cd54cddf5 tempest-TestServerVolumeAttachmentScenario-729810210 None] Created volume successfully.
Nov 05 03:58:49 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:58:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Flow 'volume_create_manager' (38f4ba0e-578a-4855-9ec7-1ef9b3781ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c23874-9271-4d2d-96de-9dc786a8c281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c23874-9271-4d2d-96de-9dc786a8c281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-169228464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3590e408-083a-47a3-988e-2d1b5fbc2926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35fc6b0acbf444ebdb3eb8024123188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:10Z,use_quota=True,user_id='987824942f5a4204a4eae81f517b7d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e38b8d-df56-4892-9e4d-e951be0730fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e38b8d-df56-4892-9e4d-e951be0730fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35176e8-e102-495a-8e32-7fd28e5f2d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35176e8-e102-495a-8e32-7fd28e5f2d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3590e408-083a-47a3-988e-2d1b5fbc2926', 'volume_name': 'volume-3590e408-083a-47a3-988e-2d1b5fbc2926', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c38a87-9241-4269-8f5d-d3ac737fae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c38a87-9241-4269-8f5d-d3ac737fae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7895930-c34b-4d53-9b37-bccd2f42d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Volume 3590e408-083a-47a3-988e-2d1b5fbc2926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3590e408-083a-47a3-988e-2d1b5fbc2926', 'volume_size': 1}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-169228464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3590e408-083a-47a3-988e-2d1b5fbc2926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35fc6b0acbf444ebdb3eb8024123188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:10Z,use_quota=True,user_id='987824942f5a4204a4eae81f517b7d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Creating volume 3590e408-083a-47a3-988e-2d1b5fbc2926 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:59:10 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:10 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926 1073741824
Nov 05 03:59:10 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:10 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926 1073741824" returned: 0 in 0.540s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:10 devstack sudo[103523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:59:10 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:10 devstack sudo[103525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926
Nov 05 03:59:10 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:11 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:11 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7895930-c34b-4d53-9b37-bccd2f42d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3590e408-083a-47a3-988e-2d1b5fbc2926', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb092a-eaee-4a16-9eef-fab4b75b4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:11 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Volume volume-3590e408-083a-47a3-988e-2d1b5fbc2926 (3590e408-083a-47a3-988e-2d1b5fbc2926): created successfully
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb092a-eaee-4a16-9eef-fab4b75b4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Flow 'volume_create_manager' (38f4ba0e-578a-4855-9ec7-1ef9b3781ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f9ecb68b-3deb-4a17-b168-92399ef8d23e tempest-TestMinimumBasicScenario-762985939 None] Created volume successfully.
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-84e4e0f9-32ae-4349-818e-b4d4a3fde9b4 req-3edf394c-efe6-42f5-a166-6d28563eb2ad tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-84e4e0f9-32ae-4349-818e-b4d4a3fde9b4 req-3edf394c-efe6-42f5-a166-6d28563eb2ad tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-84e4e0f9-32ae-4349-818e-b4d4a3fde9b4 req-3edf394c-efe6-42f5-a166-6d28563eb2ad tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-84e4e0f9-32ae-4349-818e-b4d4a3fde9b4 req-3edf394c-efe6-42f5-a166-6d28563eb2ad tempest-TestServerVolumeAttachmentScenario-729810210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-3950bffd-3e17-44d6-9665-ca682790e1dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24abcf7d-f2e2-4ae6-a571-f69f06f043d9', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:59:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-84e4e0f9-32ae-4349-818e-b4d4a3fde9b4 req-3edf394c-efe6-42f5-a166-6d28563eb2ad tempest-TestServerVolumeAttachmentScenario-729810210 None] attachment_update completed successfully.
Nov 05 03:59:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f8d48f62-98b6-413e-92e9-c3e0568ecb96 req-baa5d235-7d35-41f6-b9ea-8cf3cd39d31c tempest-TestMinimumBasicScenario-762985939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f8d48f62-98b6-413e-92e9-c3e0568ecb96 req-baa5d235-7d35-41f6-b9ea-8cf3cd39d31c tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-f8d48f62-98b6-413e-92e9-c3e0568ecb96 req-baa5d235-7d35-41f6-b9ea-8cf3cd39d31c tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-f8d48f62-98b6-413e-92e9-c3e0568ecb96 req-baa5d235-7d35-41f6-b9ea-8cf3cd39d31c tempest-TestMinimumBasicScenario-762985939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-3590e408-083a-47a3-988e-2d1b5fbc2926', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b1b9953-6d11-4d5f-b58a-668c245c8d7e', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:59:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-f8d48f62-98b6-413e-92e9-c3e0568ecb96 req-baa5d235-7d35-41f6-b9ea-8cf3cd39d31c tempest-TestMinimumBasicScenario-762985939 None] attachment_update completed successfully.
Nov 05 03:59:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-29526006-67de-4fd7-a385-2162b44ba80c req-416fdf2c-44ce-4912-a38d-162bbf6092d8 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-29526006-67de-4fd7-a385-2162b44ba80c req-416fdf2c-44ce-4912-a38d-162bbf6092d8 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-29526006-67de-4fd7-a385-2162b44ba80c req-416fdf2c-44ce-4912-a38d-162bbf6092d8 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-29526006-67de-4fd7-a385-2162b44ba80c req-416fdf2c-44ce-4912-a38d-162bbf6092d8 tempest-TestServerVolumeAttachmentScenario-729810210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a', 'name': 'volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50140935-a2f7-4349-b223-1a2df67eaa42', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4947}}
Nov 05 03:59:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-29526006-67de-4fd7-a385-2162b44ba80c req-416fdf2c-44ce-4912-a38d-162bbf6092d8 tempest-TestServerVolumeAttachmentScenario-729810210 None] attachment_update completed successfully.
Nov 05 03:59:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7e392575-d914-40d0-ad41-12d4123d0d67 req-0e7dd977-b3dc-4c64-8eca-f7bd893252a9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Terminate volume connection completed successfully.
Nov 05 03:59:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7e392575-d914-40d0-ad41-12d4123d0d67 req-0e7dd977-b3dc-4c64-8eca-f7bd893252a9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Deleting attachment 50140935-a2f7-4349-b223-1a2df67eaa42. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:59:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-92c2af89-6f9e-4669-b7de-267c8111ffd0 req-2aefaee8-0d9d-45ff-9678-9b3b0cf92a94 tempest-TestServerVolumeAttachmentScenario-729810210 None] Terminate volume connection completed successfully.
Nov 05 03:59:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-92c2af89-6f9e-4669-b7de-267c8111ffd0 req-2aefaee8-0d9d-45ff-9678-9b3b0cf92a94 tempest-TestServerVolumeAttachmentScenario-729810210 None] Deleting attachment 24abcf7d-f2e2-4ae6-a571-f69f06f043d9. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 03:59:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "cinder-0f54b8bf-95a8-406e-b848-ec5afb2e03a6-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-0f54b8bf-95a8-406e-b848-ec5afb2e03a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "cinder-quobyte-0f54b8bf-95a8-406e-b848-ec5afb2e03a6" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-quobyte-0f54b8bf-95a8-406e-b848-ec5afb2e03a6" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8965d303-bace-4a42-84b0-fe142e2e1370]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:24 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6
Nov 05 03:59:24 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:25 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6" returned: 0 in 0.387s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:25 devstack sudo[104042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6
Nov 05 03:59:25 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:25 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0f54b8bf-95a8-406e-b848-ec5afb2e03a6" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-quobyte-0f54b8bf-95a8-406e-b848-ec5afb2e03a6" released by "delete_volume" :: held 0.733s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Created reservations ['5f085402-2cbe-4fb8-b90b-2deaba4eb0f9', 'bf276837-027a-4ef8-b267-e0198776f04b', 'b93c22b7-953c-4d5f-93a3-ddf5e5a4d4de', '45507fd3-8c76-48b8-a74d-5a146a197457'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:25 devstack sudo[104045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:59:25 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "cinder-3950bffd-3e17-44d6-9665-ca682790e1dc-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-3950bffd-3e17-44d6-9665-ca682790e1dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:25 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:59:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Deleted volume successfully.
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "cinder-quobyte-3950bffd-3e17-44d6-9665-ca682790e1dc" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-quobyte-3950bffd-3e17-44d6-9665-ca682790e1dc" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb20e24a-a494-40cd-91b2-fcdad35b1e76 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-0f54b8bf-95a8-406e-b848-ec5afb2e03a6-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd750d-2d2e-4474-a0dd-7617d62e7ad0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:26 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc
Nov 05 03:59:26 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:26 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:26 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc
Nov 05 03:59:26 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:26 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3950bffd-3e17-44d6-9665-ca682790e1dc" returned: 0 in 0.265s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-quobyte-3950bffd-3e17-44d6-9665-ca682790e1dc" released by "delete_volume" :: held 0.687s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Created reservations ['151339eb-54fb-4c52-8350-3fa1a2c9cf02', '411c040d-79c5-4d06-8068-50e8ca51aeae', 'fef4294a-ffb6-4d55-8330-88c681e481ca', 'f22966e7-a519-4688-821f-9fa3976d784b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:26 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:59:26 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:27 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:59:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Deleted volume successfully.
Nov 05 03:59:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a7d9d7bf-7e61-4ad2-af4f-f6abdece95d9 tempest-TestServerVolumeAttachmentScenario-729810210 None] Lock "cinder-3950bffd-3e17-44d6-9665-ca682790e1dc-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:36 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=28,cinder:DELETE=1,cinder:SELECT=31,cinder:INSERT=3 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:59:37 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=38,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Flow 'volume_create_manager' (da217f8c-568d-4907-b12d-e0d1f9d83ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45536103-43d7-48a3-90a9-18276098e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45536103-43d7-48a3-90a9-18276098e053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf63dc33-cebf-4797-ab2c-ca4ad060e865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e179514f3984f879a1151a3a451b14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:45Z,use_quota=True,user_id='1e68fe2d8dd84c499cfe1d73e6c8c22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9957b425-e106-451d-aaf9-c52087ae5075),volume_type_id=9957b425-e106-451d-aaf9-c52087ae5075)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7b8982-afad-437b-af01-caea1da45794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7b8982-afad-437b-af01-caea1da45794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b08a7a-f3a2-4a59-a8d0-3e3a60997967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b08a7a-f3a2-4a59-a8d0-3e3a60997967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf63dc33-cebf-4797-ab2c-ca4ad060e865', 'volume_name': 'volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865', 'volume_size': 1, 'image_id': '97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42a72491c2756ed6f5749efd87a7d573', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e179514f3984f879a1151a3a451b14d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b94cfc1ebeb59291b8171a4696d174775e8cd63f490ef7646e8d5d7e5d749ced6fffeebcb518e72e60f2bfda893297446f5f900f19ed18f2e796c082534bf99', 'id': '97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'created_at': datetime.datetime(2026, 11, 5, 2, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 59, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab54fa930>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8928c4e6-100c-4e38-901a-431fb5822b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8928c4e6-100c-4e38-901a-431fb5822b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8585e0a4-7529-40ef-87a0-02d025d57511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Volume cf63dc33-cebf-4797-ab2c-ca4ad060e865: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865', 'volume_size': 1, 'image_id': '97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42a72491c2756ed6f5749efd87a7d573', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e179514f3984f879a1151a3a451b14d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b94cfc1ebeb59291b8171a4696d174775e8cd63f490ef7646e8d5d7e5d749ced6fffeebcb518e72e60f2bfda893297446f5f900f19ed18f2e796c082534bf99', 'id': '97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'created_at': datetime.datetime(2026, 11, 5, 2, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 59, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab54fa930>}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Trying to clone cf63dc33-cebf-4797-ab2c-ca4ad060e865 from image 97f675c2-277e-46b7-b6dd-0bb76cb20e97 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:59:45 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d15f4-2c2d-4014-9f51-4f49dce742eb]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:45 devstack sudo[104164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD
Nov 05 03:59:45 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:46 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:46 devstack sudo[104168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD
Nov 05 03:59:46 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:46 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Temporary image 97f675c2-277e-46b7-b6dd-0bb76cb20e97 is fetched for user 1e68fe2d8dd84c499cfe1d73e6c8c22b. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b134b453-e5b0-431f-813e-57660f7a8cd8]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:46 devstack sudo[104173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD
Nov 05 03:59:46 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:46 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:47 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD
Nov 05 03:59:47 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:47 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf63dc33-cebf-4797-ab2c-ca4ad060e865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e179514f3984f879a1151a3a451b14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:45Z,use_quota=True,user_id='1e68fe2d8dd84c499cfe1d73e6c8c22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9957b425-e106-451d-aaf9-c52087ae5075),volume_type_id=9957b425-e106-451d-aaf9-c52087ae5075)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Creating volume cf63dc33-cebf-4797-ab2c-ca4ad060e865 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:59:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:47 devstack sudo[104182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 1073741824
Nov 05 03:59:47 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:47 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 1073741824" returned: 0 in 0.492s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:47 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865
Nov 05 03:59:47 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:48 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865" returned: 0 in 0.323s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Attempting download of 97f675c2-277e-46b7-b6dd-0bb76cb20e97 ((None, [{'url': 'file:///opt/stack/data/glance/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'metadata': {}}])) to volume cf63dc33-cebf-4797-ab2c-ca4ad060e865. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4d789e-ea67-4eef-9649-0724b13efc27]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f675c2-277e-46b7-b6dd-0bb76cb20e97_l32mzrz9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:48 devstack sudo[104190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f675c2-277e-46b7-b6dd-0bb76cb20e97_l32mzrz9
Nov 05 03:59:48 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:48 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f675c2-277e-46b7-b6dd-0bb76cb20e97_l32mzrz9" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f675c2-277e-46b7-b6dd-0bb76cb20e97_l32mzrz9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:48 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f675c2-277e-46b7-b6dd-0bb76cb20e97_l32mzrz9
Nov 05 03:59:48 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:49 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f675c2-277e-46b7-b6dd-0bb76cb20e97_l32mzrz9" returned: 1 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f675c2-277e-46b7-b6dd-0bb76cb20e97_l32mzrz9' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[de584b43-0417-434d-915e-797436e4cdf8]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:49 devstack sudo[104198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD
Nov 05 03:59:49 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:49 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:49 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD
Nov 05 03:59:49 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:49 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] 97f675c2-277e-46b7-b6dd-0bb76cb20e97 was raw, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:49 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865
Nov 05 03:59:49 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:50 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865" returned: 0 in 0.473s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97f675c2-277e-46b7-b6dd-0bb76cb20e97_geajzmbndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:59:50 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:50 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 1G
Nov 05 03:59:50 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:50 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 1G" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Downloaded image 97f675c2-277e-46b7-b6dd-0bb76cb20e97 ((None, [{'url': 'file:///opt/stack/data/glance/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'metadata': {}}])) to volume cf63dc33-cebf-4797-ab2c-ca4ad060e865 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Temporary image 97f675c2-277e-46b7-b6dd-0bb76cb20e97 for user 1e68fe2d8dd84c499cfe1d73e6c8c22b is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Marking volume cf63dc33-cebf-4797-ab2c-ca4ad060e865 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Copying metadata from image 97f675c2-277e-46b7-b6dd-0bb76cb20e97 to cf63dc33-cebf-4797-ab2c-ca4ad060e865. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Creating volume glance metadata for volume cf63dc33-cebf-4797-ab2c-ca4ad060e865 backed by image 97f675c2-277e-46b7-b6dd-0bb76cb20e97 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '42a72491c2756ed6f5749efd87a7d573', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8585e0a4-7529-40ef-87a0-02d025d57511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865', 'volume_size': 1, 'image_id': '97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42a72491c2756ed6f5749efd87a7d573', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e179514f3984f879a1151a3a451b14d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b94cfc1ebeb59291b8171a4696d174775e8cd63f490ef7646e8d5d7e5d749ced6fffeebcb518e72e60f2bfda893297446f5f900f19ed18f2e796c082534bf99', 'id': '97f675c2-277e-46b7-b6dd-0bb76cb20e97', 'created_at': datetime.datetime(2026, 11, 5, 2, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 59, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f675c2-277e-46b7-b6dd-0bb76cb20e97/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab54fa930>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b93cf3-b346-4aa6-882c-22df4a2ebca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Volume volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 (cf63dc33-cebf-4797-ab2c-ca4ad060e865): created successfully
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b93cf3-b346-4aa6-882c-22df4a2ebca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Flow 'volume_create_manager' (da217f8c-568d-4907-b12d-e0d1f9d83ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7c02f554-a296-4dc5-9542-946804e3599d tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Created volume successfully.
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Acquiring lock "cinder-cf63dc33-cebf-4797-ab2c-ca4ad060e865-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "cinder-cf63dc33-cebf-4797-ab2c-ca4ad060e865-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Acquiring lock "cinder-quobyte-cf63dc33-cebf-4797-ab2c-ca4ad060e865" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "cinder-quobyte-cf63dc33-cebf-4797-ab2c-ca4ad060e865" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2dcf1e-1a7f-49ba-8c4a-7c316558a06d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:51 devstack sudo[104223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865
Nov 05 03:59:51 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:51 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:51 devstack sudo[104228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865
Nov 05 03:59:51 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:52 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cf63dc33-cebf-4797-ab2c-ca4ad060e865" returned: 0 in 0.265s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "cinder-quobyte-cf63dc33-cebf-4797-ab2c-ca4ad060e865" released by "delete_volume" :: held 0.698s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:52 devstack cinder-volume[87401]: WARNING cinder.quota [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:59:52 devstack cinder-volume[87401]: WARNING cinder.quota [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Created reservations ['964849f0-d704-4262-bdee-7e0a913731cb', '067fc27e-ce85-43b4-9621-84bdfaaf86e2', '7dc20085-3fae-468d-a8c6-2c1841984270', 'ad9a8843-6470-48f3-be8f-f6cdc41ed748'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:52 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 03:59:52 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:52 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.310s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:59:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Deleted volume successfully.
Nov 05 03:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f97a6cfb-93a0-4d1e-ad83-b137536638ae tempest-VolumeAndVolumeTypeFromImageTest-1098849897 None] Lock "cinder-cf63dc33-cebf-4797-ab2c-ca4ad060e865-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (8d80534b-4aa7-4f31-a33a-b1e8b9d9cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c6b2d6-966b-479e-b373-e7c2435a9304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c6b2d6-966b-479e-b373-e7c2435a9304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065188839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29e7a4f-900c-40a2-a913-63f81a3f0057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:57Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d1c6be-a899-4800-8b79-efc0b68bc340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d1c6be-a899-4800-8b79-efc0b68bc340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f0e17b-4c59-49b2-88e3-b35ff4c84a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f0e17b-4c59-49b2-88e3-b35ff4c84a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29e7a4f-900c-40a2-a913-63f81a3f0057', 'volume_name': 'volume-b29e7a4f-900c-40a2-a913-63f81a3f0057', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b81517-d0d3-431b-8621-64b9730eda35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b81517-d0d3-431b-8621-64b9730eda35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10def799-a748-4316-aee5-405a7ea7d054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume b29e7a4f-900c-40a2-a913-63f81a3f0057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29e7a4f-900c-40a2-a913-63f81a3f0057', 'volume_size': 1}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065188839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29e7a4f-900c-40a2-a913-63f81a3f0057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:57Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Creating volume b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:59:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:57 devstack sudo[104242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 1073741824
Nov 05 03:59:57 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:57 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 1073741824" returned: 0 in 0.425s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:57 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057
Nov 05 03:59:57 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:57 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10def799-a748-4316-aee5-405a7ea7d054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29e7a4f-900c-40a2-a913-63f81a3f0057', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10171084-d64d-47b4-94da-c886d6cb3607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 (b29e7a4f-900c-40a2-a913-63f81a3f0057): created successfully
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10171084-d64d-47b4-94da-c886d6cb3607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (8d80534b-4aa7-4f31-a33a-b1e8b9d9cb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cd4eea2f-f595-45e3-bf39-86391f997df3 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created volume successfully.
Nov 05 03:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Creating offline snapshot bc443ce1-417d-40c1-a996-de12aaba6afb of volume b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:59:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaa1747-57bd-4198-a2cc-cbf9182397e7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:58 devstack sudo[104255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057
Nov 05 03:59:58 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:58 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057" returned: 0 in 0.443s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:58 devstack sudo[104262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb 1G
Nov 05 03:59:58 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:59 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb 1G" returned: 0 in 0.493s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:59 devstack sudo[104269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb
Nov 05 03:59:59 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:59 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:59 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb is being set with open permissions: ugo+rw
Nov 05 03:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:59 devstack sudo[104275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb
Nov 05 03:59:59 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:59 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb" returned: 0 in 0.241s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:59 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.info
Nov 05 03:59:59 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:00 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.info" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:00 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.info is being set with open permissions: ugo+rw
Nov 05 04:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:00 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.info
Nov 05 04:00:00 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:00 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.info" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-92879af6-6c20-44d9-892b-780e1445e294 tempest-CreateVolumesFromSnapshotTest-2663723 None] Create snapshot completed successfully
Nov 05 04:00:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-a9d92f30-a50e-49e1-8858-8adcdd844c64 req-3177cec3-80bf-42c3-b587-89f8595e8ea1 tempest-TestMinimumBasicScenario-762985939 None] Terminate volume connection completed successfully.
Nov 05 04:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-a9d92f30-a50e-49e1-8858-8adcdd844c64 req-3177cec3-80bf-42c3-b587-89f8595e8ea1 tempest-TestMinimumBasicScenario-762985939 None] Deleting attachment 6b1b9953-6d11-4d5f-b58a-668c245c8d7e. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5078}}
Nov 05 04:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Acquiring lock "cinder-3590e408-083a-47a3-988e-2d1b5fbc2926-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Lock "cinder-3590e408-083a-47a3-988e-2d1b5fbc2926-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Acquiring lock "cinder-quobyte-3590e408-083a-47a3-988e-2d1b5fbc2926" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Lock "cinder-quobyte-3590e408-083a-47a3-988e-2d1b5fbc2926" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be1992e-8714-4687-8c23-29eedb456555]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:01 devstack sudo[104291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926
Nov 05 04:00:01 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (4326d488-50dd-443f-9e65-9ef150bf48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e807b7f-7f9f-4b56-bce3-7814ecfa85c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e807b7f-7f9f-4b56-bce3-7814ecfa85c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1810576053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08dbef-9ba6-4ef4-95ae-967e5affb9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:02Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cad8ba9-c3bc-46da-8e27-309036891258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cad8ba9-c3bc-46da-8e27-309036891258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ccc179-2225-42bb-a555-832aec139f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ccc179-2225-42bb-a555-832aec139f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f08dbef-9ba6-4ef4-95ae-967e5affb9f7', 'volume_name': 'volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528a750f-266a-48b6-8906-2c8568382f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528a750f-266a-48b6-8906-2c8568382f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e9984b-b60f-4264-aacb-1a33ee2ab785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume 8f08dbef-9ba6-4ef4-95ae-967e5affb9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7', 'volume_size': 1}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1810576053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08dbef-9ba6-4ef4-95ae-967e5affb9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:02Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Creating volume 8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:02 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926" returned: 0 in 0.459s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:02 devstack sudo[104296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 1073741824
Nov 05 04:00:02 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:02 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926
Nov 05 04:00:02 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (f2bb7618-9af9-4a1f-a22a-07592c430131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22da16c6-5b91-402d-83ed-8aecbeb54f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3590e408-083a-47a3-988e-2d1b5fbc2926" returned: 0 in 0.323s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22da16c6-5b91-402d-83ed-8aecbeb54f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622201187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311165fe-997d-4961-94e9-0f8c649d803a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:02Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb6217-5aec-4a8d-89b1-697b5098312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb6217-5aec-4a8d-89b1-697b5098312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6cf33b-581a-47ca-b931-f81896843c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6cf33b-581a-47ca-b931-f81896843c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311165fe-997d-4961-94e9-0f8c649d803a', 'volume_name': 'volume-311165fe-997d-4961-94e9-0f8c649d803a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6e6569-c99d-4725-8838-f959d52464dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6e6569-c99d-4725-8838-f959d52464dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81161f36-8256-46e9-98a4-6430a0ed29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume 311165fe-997d-4961-94e9-0f8c649d803a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311165fe-997d-4961-94e9-0f8c649d803a', 'volume_size': 1}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Lock "cinder-quobyte-3590e408-083a-47a3-988e-2d1b5fbc2926" released by "delete_volume" :: held 0.884s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Created reservations ['ab41ba53-8639-4c13-a1a8-f0b4f1e7bc28', 'cb140de4-53b1-4fdf-afda-80e0012fc793', 'b541c257-6efc-4694-8e9b-a5aaef7ed5ad', '9c7d9c9d-35a8-4fb3-829e-d67b0b9adee8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:02 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 1073741824" returned: 0 in 0.613s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:02 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:02 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:02 devstack sudo[104306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7
Nov 05 04:00:02 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (d2a342dc-6750-4557-8402-afcde3d229de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5549fbdd-906e-4c67-81fa-11fa06a5ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5549fbdd-906e-4c67-81fa-11fa06a5ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-80366400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f274bae5-4e16-4be0-9be0-b1e6c898e812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:03Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff63530-65bd-4c37-b43a-17840e62b046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff63530-65bd-4c37-b43a-17840e62b046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c4a1a5-549c-4804-a901-50791e441099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c4a1a5-549c-4804-a901-50791e441099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f274bae5-4e16-4be0-9be0-b1e6c898e812', 'volume_name': 'volume-f274bae5-4e16-4be0-9be0-b1e6c898e812', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9037b801-c8a7-4d27-9858-ee1038d1f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9037b801-c8a7-4d27-9858-ee1038d1f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d77705-9fca-44d5-834a-3c216fe7f72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume f274bae5-4e16-4be0-9be0-b1e6c898e812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f274bae5-4e16-4be0-9be0-b1e6c898e812', 'volume_size': 1}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Deleted volume successfully.
Nov 05 04:00:03 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0431e1c-a2a4-40a4-a745-a10263d58b43 tempest-TestMinimumBasicScenario-762985939 None] Lock "cinder-3590e408-083a-47a3-988e-2d1b5fbc2926-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622201187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311165fe-997d-4961-94e9-0f8c649d803a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:02Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Creating volume 311165fe-997d-4961-94e9-0f8c649d803a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:03 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e9984b-b60f-4264-aacb-1a33ee2ab785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack sudo[104311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a 1073741824
Nov 05 04:00:03 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb02a1-53c6-4d41-af7c-80a1c63c39bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 (8f08dbef-9ba6-4ef4-95ae-967e5affb9f7): created successfully
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb02a1-53c6-4d41-af7c-80a1c63c39bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (4326d488-50dd-443f-9e65-9ef150bf48a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-eb2a9b31-3a56-414b-a67f-19220b560573 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created volume successfully.
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (4be40852-b071-4b96-be14-60542263370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077dceda-b557-48ce-9559-3f5470338664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077dceda-b557-48ce-9559-3f5470338664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709429552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6ba060-18b3-4d1d-aa42-3e747cf40c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:03Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcfc7e7-27b0-4530-92ac-2fc576630f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcfc7e7-27b0-4530-92ac-2fc576630f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e46b682-5beb-4138-8484-3f1a235f89bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e46b682-5beb-4138-8484-3f1a235f89bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b6ba060-18b3-4d1d-aa42-3e747cf40c84', 'volume_name': 'volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d2bc3a-1699-4a39-8601-5b8441271586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d2bc3a-1699-4a39-8601-5b8441271586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dedece0-0369-4448-b930-2567ed05f718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume 9b6ba060-18b3-4d1d-aa42-3e747cf40c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84', 'volume_size': 1}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:03 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a 1073741824" returned: 0 in 0.573s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (9a5269dc-bdf8-4767-947d-21beb488cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d279b86c-e290-4dbc-b5ce-e64894d5f69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d279b86c-e290-4dbc-b5ce-e64894d5f69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136080788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2370edc-a2a6-4811-8d8c-b32e2937214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:04Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack sudo[104318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a
Nov 05 04:00:03 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e030776-cb20-4a90-998e-b32d7d0b9a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e030776-cb20-4a90-998e-b32d7d0b9a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d87f592-d274-4c3b-bd1f-8a7a10dae43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d87f592-d274-4c3b-bd1f-8a7a10dae43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2370edc-a2a6-4811-8d8c-b32e2937214f', 'volume_name': 'volume-a2370edc-a2a6-4811-8d8c-b32e2937214f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b498fb-38bc-4c28-8fa0-7567fd260024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b498fb-38bc-4c28-8fa0-7567fd260024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa539a6-23b6-4c6f-aec6-859d295532ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume a2370edc-a2a6-4811-8d8c-b32e2937214f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2370edc-a2a6-4811-8d8c-b32e2937214f', 'volume_size': 1}
Nov 05 04:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:03 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-80366400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f274bae5-4e16-4be0-9be0-b1e6c898e812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:03Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Creating volume f274bae5-4e16-4be0-9be0-b1e6c898e812 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:04 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812 1073741824
Nov 05 04:00:04 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81161f36-8256-46e9-98a4-6430a0ed29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311165fe-997d-4961-94e9-0f8c649d803a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddb9702-b5d0-41ad-b32c-4ee44a7182cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume volume-311165fe-997d-4961-94e9-0f8c649d803a (311165fe-997d-4961-94e9-0f8c649d803a): created successfully
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddb9702-b5d0-41ad-b32c-4ee44a7182cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (f2bb7618-9af9-4a1f-a22a-07592c430131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f08b4e51-787a-450b-8aaa-c10ba4696ff4 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created volume successfully.
Nov 05 04:00:04 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812 1073741824" returned: 0 in 0.612s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:04 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812
Nov 05 04:00:04 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:04 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812" returned: 0 in 0.266s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709429552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6ba060-18b3-4d1d-aa42-3e747cf40c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:03Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Creating volume 9b6ba060-18b3-4d1d-aa42-3e747cf40c84 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d77705-9fca-44d5-834a-3c216fe7f72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f274bae5-4e16-4be0-9be0-b1e6c898e812', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d4258-162b-4f52-956a-3e88a1837e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:04 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84 1073741824
Nov 05 04:00:04 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume volume-f274bae5-4e16-4be0-9be0-b1e6c898e812 (f274bae5-4e16-4be0-9be0-b1e6c898e812): created successfully
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d4258-162b-4f52-956a-3e88a1837e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (d2a342dc-6750-4557-8402-afcde3d229de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-de54a963-6445-4174-bbd7-0dd56ba64a1a tempest-CreateVolumesFromSnapshotTest-2663723 None] Created volume successfully.
Nov 05 04:00:05 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84 1073741824" returned: 0 in 0.593s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:05 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84
Nov 05 04:00:05 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:05 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84" returned: 0 in 0.262s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.079s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136080788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2370edc-a2a6-4811-8d8c-b32e2937214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b02f8406b54895a63ed194716cbc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:04Z,use_quota=True,user_id='81462058d2b04b698677e853f5904791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Creating volume a2370edc-a2a6-4811-8d8c-b32e2937214f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dedece0-0369-4448-b930-2567ed05f718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ef95b2-aaa4-419e-a8da-1828cd5573b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:05 devstack sudo[104362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f 1073741824
Nov 05 04:00:05 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84 (9b6ba060-18b3-4d1d-aa42-3e747cf40c84): created successfully
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ef95b2-aaa4-419e-a8da-1828cd5573b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (4be40852-b071-4b96-be14-60542263370e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d35dabf2-62f9-4cca-b343-3c2c3fce2eaf tempest-CreateVolumesFromSnapshotTest-2663723 None] Created volume successfully.
Nov 05 04:00:06 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f 1073741824" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:06 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f
Nov 05 04:00:06 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:06 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa539a6-23b6-4c6f-aec6-859d295532ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2370edc-a2a6-4811-8d8c-b32e2937214f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aec4542-7fd2-430b-9a6c-8c1e2fe3cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Volume volume-a2370edc-a2a6-4811-8d8c-b32e2937214f (a2370edc-a2a6-4811-8d8c-b32e2937214f): created successfully
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aec4542-7fd2-430b-9a6c-8c1e2fe3cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Flow 'volume_create_manager' (9a5269dc-bdf8-4767-947d-21beb488cc58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-061a8258-6edb-4b3f-8b87-8ec9e86b2e3e tempest-CreateVolumesFromSnapshotTest-2663723 None] Created volume successfully.
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-a2370edc-a2a6-4811-8d8c-b32e2937214f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-a2370edc-a2a6-4811-8d8c-b32e2937214f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-a2370edc-a2a6-4811-8d8c-b32e2937214f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-a2370edc-a2a6-4811-8d8c-b32e2937214f" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b74e7d-4e5d-4d9e-aad4-b26ad9e832ea]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:07 devstack sudo[104371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f
Nov 05 04:00:07 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:07 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:07 devstack sudo[104376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f
Nov 05 04:00:07 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:07 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a2370edc-a2a6-4811-8d8c-b32e2937214f" returned: 0 in 0.248s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-a2370edc-a2a6-4811-8d8c-b32e2937214f" released by "delete_volume" :: held 0.671s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created reservations ['a0141fff-8226-48b7-9a60-4b5d32c20c9c', '1ca4d02b-6759-4c16-b870-6ef50a004382', 'e8cafd17-9f17-4127-b224-af88bd9b5226', '03b73e7f-f09d-47e6-a913-9e2cf3c591b2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:07 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:07 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:08 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Deleted volume successfully.
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-9b6ba060-18b3-4d1d-aa42-3e747cf40c84-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-9b6ba060-18b3-4d1d-aa42-3e747cf40c84-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-58627ec0-8d7d-41df-9667-7f7a0da13d30 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-a2370edc-a2a6-4811-8d8c-b32e2937214f-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-9b6ba060-18b3-4d1d-aa42-3e747cf40c84" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-9b6ba060-18b3-4d1d-aa42-3e747cf40c84" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3055481-013b-442d-942c-1eb752aa7040]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:08 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84
Nov 05 04:00:08 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:08 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84" returned: 0 in 0.372s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:08 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84
Nov 05 04:00:08 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:09 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9b6ba060-18b3-4d1d-aa42-3e747cf40c84" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-9b6ba060-18b3-4d1d-aa42-3e747cf40c84" released by "delete_volume" :: held 0.662s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created reservations ['96412534-270e-4cdb-8681-35a704f8e6cb', 'caab1819-e0df-4abe-ab50-29048fc619aa', '2fdec644-7ab1-48af-92ba-723891f21d9a', '2f4c3305-9fac-4985-9fcf-ad68fa72881e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:09 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:09 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:09 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Deleted volume successfully.
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6ec5842d-5b6d-487d-8198-a12c66b2f2b0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-9b6ba060-18b3-4d1d-aa42-3e747cf40c84-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-f274bae5-4e16-4be0-9be0-b1e6c898e812-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-f274bae5-4e16-4be0-9be0-b1e6c898e812-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-f274bae5-4e16-4be0-9be0-b1e6c898e812" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-f274bae5-4e16-4be0-9be0-b1e6c898e812" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[634183ad-8e17-4b3b-9007-91c504e1ca65]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:09 devstack sudo[104395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812
Nov 05 04:00:09 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:09 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812" returned: 0 in 0.354s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:09 devstack sudo[104400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812
Nov 05 04:00:09 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:10 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f274bae5-4e16-4be0-9be0-b1e6c898e812" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-f274bae5-4e16-4be0-9be0-b1e6c898e812" released by "delete_volume" :: held 0.681s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created reservations ['cb3fc0f6-efae-47f9-ba0c-0b59dbd43b23', '11598149-6c07-4751-9449-fecb448b6016', 'ab268705-c6b5-4330-980c-04d494add69e', 'b50fea52-c542-482d-8e0e-a49591497a9d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:10 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:10 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:10 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.277s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Deleted volume successfully.
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-311165fe-997d-4961-94e9-0f8c649d803a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-311165fe-997d-4961-94e9-0f8c649d803a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d905c5c-cedb-4c9e-be1b-1171a4a1c5d0 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-f274bae5-4e16-4be0-9be0-b1e6c898e812-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:10 devstack sudo[104406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:10 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-311165fe-997d-4961-94e9-0f8c649d803a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-311165fe-997d-4961-94e9-0f8c649d803a" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d14d0-d192-4f22-b82a-13b479d14153]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:10 devstack sudo[104408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a
Nov 05 04:00:10 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:10 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.262s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 04:00:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 04:00:11 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:11 devstack sudo[104415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a
Nov 05 04:00:11 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:11 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-311165fe-997d-4961-94e9-0f8c649d803a" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-311165fe-997d-4961-94e9-0f8c649d803a" released by "delete_volume" :: held 0.696s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created reservations ['254d6a03-805b-41b7-bbf4-adcf9df8297c', '60879023-5b37-464d-a109-dad63dd0955b', '9aa5b771-ae89-4022-ba16-388cde457fe0', '1e4c8c88-a9da-481a-9399-30743644c87e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:11 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:11 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:11 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Deleted volume successfully.
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-380dbd99-bc94-4b0b-b8cc-3ec1b8619fc2 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-311165fe-997d-4961-94e9-0f8c649d803a-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[301c749f-1415-40e2-bd56-6eb74f73f83b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:12 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7
Nov 05 04:00:12 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:12 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7" returned: 0 in 0.358s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:12 devstack sudo[104426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7
Nov 05 04:00:12 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:12 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7" returned: 0 in 0.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7" released by "delete_volume" :: held 0.690s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created reservations ['f91c0abf-bd89-4cdd-ab51-2e7c7fa2fcc7', 'bdbd5386-c55a-45e8-9791-26462a422af2', '1925b81b-db64-4bb4-bbb2-414938f23775', 'f1567eba-3a73-41e5-bdc1-cabc6c0803d3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:12 devstack sudo[104430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:12 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-bc443ce1-417d-40c1-a996-de12aaba6afb-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:13 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-bc443ce1-417d-40c1-a996-de12aaba6afb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-b29e7a4f-900c-40a2-a913-63f81a3f0057" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Deleted volume successfully.
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-b29e7a4f-900c-40a2-a913-63f81a3f0057" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-bc443ce1-417d-40c1-a996-de12aaba6afb" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-bc443ce1-417d-40c1-a996-de12aaba6afb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Deleting offline snapshot bc443ce1-417d-40c1-a996-de12aaba6afb of volume b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] snapshot_file for this snap is: volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-28ad24ca-feea-4fa1-a8d1-9527f691ef19 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-8f08dbef-9ba6-4ef4-95ae-967e5affb9f7-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f8001c-b418-421d-aeb8-bffbd5dfbbf6]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:13 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb
Nov 05 04:00:13 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:13 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b29e7a4f-900c-40a2-a913-63f81a3f0057(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9da2df-07db-497c-b5c6-791cff43e5cd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:13 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057
Nov 05 04:00:13 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:13 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:13 devstack sudo[104443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb
Nov 05 04:00:13 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:14 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:14 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb
Nov 05 04:00:14 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:14 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057.bc443ce1-417d-40c1-a996-de12aaba6afb" returned: 0 in 0.249s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-bc443ce1-417d-40c1-a996-de12aaba6afb" released by "_delete_snapshot" :: held 1.479s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-b29e7a4f-900c-40a2-a913-63f81a3f0057" released by "delete_snapshot" :: held 1.508s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:14 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Created reservations ['c6bec35d-fdd2-406c-a205-0dc9147ae176', 'dc25dc38-e198-4455-b36c-856701aeaf9b', '1b5b6de5-4e02-44c4-8907-82d278b08702', 'a2eb1557-8826-4576-8ce2-d447fe134295'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Delete snapshot completed successfully.
Nov 05 04:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5b60049-b83b-4111-99be-f8efcdc116bb tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-bc443ce1-417d-40c1-a996-de12aaba6afb-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-b29e7a4f-900c-40a2-a913-63f81a3f0057-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-b29e7a4f-900c-40a2-a913-63f81a3f0057-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "cinder-quobyte-b29e7a4f-900c-40a2-a913-63f81a3f0057" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-b29e7a4f-900c-40a2-a913-63f81a3f0057" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[977048a9-9ff6-4c30-8800-90a5fc160960]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:15 devstack sudo[104452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057
Nov 05 04:00:15 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:15 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:15 devstack sudo[104457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057
Nov 05 04:00:15 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:15 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b29e7a4f-900c-40a2-a913-63f81a3f0057" returned: 0 in 0.244s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-quobyte-b29e7a4f-900c-40a2-a913-63f81a3f0057" released by "delete_volume" :: held 0.712s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Created reservations ['3ea7db0b-da68-46a9-9242-9f43f89c7db7', '12197ab7-be5c-4812-a5c8-72381cf37ccc', '0b2b527f-e68b-4be9-b14c-4acedff7fb20', 'a705de6a-a043-44cf-a042-38c1e07bffdc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:16 devstack sudo[104460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:16 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:16 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Deleted volume successfully.
Nov 05 04:00:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-18127e4b-0dc1-43dd-8299-d64091366066 tempest-CreateVolumesFromSnapshotTest-2663723 None] Lock "cinder-b29e7a4f-900c-40a2-a913-63f81a3f0057-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Flow 'volume_create_manager' (23c2d117-c546-4cd7-826b-c88f9324849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8cb0d6-e84c-4c59-989b-3403265c7450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8cb0d6-e84c-4c59-989b-3403265c7450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522e995d-489e-4d57-a45c-343f80192235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3b9109b41b47d3a8f2c2ee3afe6689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:19Z,use_quota=True,user_id='1c32a2639d8348fa98dc680f879728b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664304fc-b0d8-4ccf-80b1-33110489e448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664304fc-b0d8-4ccf-80b1-33110489e448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01734dac-2ce3-4a6b-a525-aad059bc2480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01734dac-2ce3-4a6b-a525-aad059bc2480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522e995d-489e-4d57-a45c-343f80192235', 'volume_name': 'volume-522e995d-489e-4d57-a45c-343f80192235', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ee626-be29-44c4-9355-1ebc97ae6e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ee626-be29-44c4-9355-1ebc97ae6e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79da310d-8d9e-49b3-b06f-f6c34c8eefe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Volume 522e995d-489e-4d57-a45c-343f80192235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522e995d-489e-4d57-a45c-343f80192235', 'volume_size': 1}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522e995d-489e-4d57-a45c-343f80192235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3b9109b41b47d3a8f2c2ee3afe6689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:19Z,use_quota=True,user_id='1c32a2639d8348fa98dc680f879728b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Creating volume 522e995d-489e-4d57-a45c-343f80192235 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:18 devstack sudo[104464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235 1073741824
Nov 05 04:00:18 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:19 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235 1073741824" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:19 devstack sudo[104472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235
Nov 05 04:00:19 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:19 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79da310d-8d9e-49b3-b06f-f6c34c8eefe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522e995d-489e-4d57-a45c-343f80192235', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1c0fc8-dc70-4253-bcb1-218fc84fa9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Volume volume-522e995d-489e-4d57-a45c-343f80192235 (522e995d-489e-4d57-a45c-343f80192235): created successfully
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1c0fc8-dc70-4253-bcb1-218fc84fa9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Flow 'volume_create_manager' (23c2d117-c546-4cd7-826b-c88f9324849b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b2d0132d-e2da-40bb-ae70-ae343b5d7cde tempest-CinderUnicodeTest-705070389 None] Created volume successfully.
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Flow 'volume_create_manager' (ff24faed-66ee-4cae-9e37-ba16bdad72d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bd46cd-b59b-45ef-b2f7-3126d26a8dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bd46cd-b59b-45ef-b2f7-3126d26a8dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-821942355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cb4b9e-5e8c-4991-b1c3-bf2c7802c507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3b9109b41b47d3a8f2c2ee3afe6689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:20Z,use_quota=True,user_id='1c32a2639d8348fa98dc680f879728b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e2f513-1894-419a-aedc-d9565ad5b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e2f513-1894-419a-aedc-d9565ad5b38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb3eeca-7d60-4150-a494-667af87a3036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb3eeca-7d60-4150-a494-667af87a3036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cb4b9e-5e8c-4991-b1c3-bf2c7802c507', 'volume_name': 'volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68cc755-3dfe-4b02-8762-a3394f526abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68cc755-3dfe-4b02-8762-a3394f526abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7e67d1-1ec0-4d97-8e9c-5c44b6a9477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Volume 13cb4b9e-5e8c-4991-b1c3-bf2c7802c507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507', 'volume_size': 1}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-821942355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cb4b9e-5e8c-4991-b1c3-bf2c7802c507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3b9109b41b47d3a8f2c2ee3afe6689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:20Z,use_quota=True,user_id='1c32a2639d8348fa98dc680f879728b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Creating volume 13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:20 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:20 devstack sudo[104476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 1073741824
Nov 05 04:00:20 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:20 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 1073741824" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:20 devstack sudo[104482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507
Nov 05 04:00:20 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:20 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7e67d1-1ec0-4d97-8e9c-5c44b6a9477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f37a09-f4a1-4cf1-a2ed-c41c749d83c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Volume volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 (13cb4b9e-5e8c-4991-b1c3-bf2c7802c507): created successfully
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f37a09-f4a1-4cf1-a2ed-c41c749d83c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Flow 'volume_create_manager' (ff24faed-66ee-4cae-9e37-ba16bdad72d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-09d49756-848e-4374-9888-1e81d3d6833b tempest-CinderUnicodeTest-705070389 None] Created volume successfully.
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Creating offline snapshot cf99a435-455a-4f02-ab2e-2bc68502a27b of volume 13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3354634-48fe-4c76-9b6a-4307a8531aa3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:21 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507
Nov 05 04:00:21 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Flow 'volume_create_manager' (335d0317-bb33-44e6-8e4b-e44478f7a492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f371f1-c6f3-4a53-86f8-75d5d2e576f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f371f1-c6f3-4a53-86f8-75d5d2e576f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e5246d-6376-4c37-b9f2-5bb83cf63cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d768d73fdd624573b9b6d554939c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:22Z,use_quota=True,user_id='dc08732b9f8145aaa4a54cd5051e2905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a961f1a-a735-4ad3-a433-a6e1d0054698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a961f1a-a735-4ad3-a433-a6e1d0054698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6fceb9-b637-4a08-9fbb-96b03547ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:00:21 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6fceb9-b637-4a08-9fbb-96b03547ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57e5246d-6376-4c37-b9f2-5bb83cf63cf7', 'volume_name': 'volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7', 'volume_size': 1, 'image_id': 'd36926bf-e886-4005-aff2-2edf2de44c03', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d36926bf-e886-4005-aff2-2edf2de44c03', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e9c44743ec538bdb475695a549a188c4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd768d73fdd624573b9b6d554939c94ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5bbdffa848b615910e1145d27b17cd330688571960377bcf0df8aa646337b8ab0cc77d2b48480eaca92867d29142367726edd9a01ffaa49312f62ae7ed0426e5', 'id': 'd36926bf-e886-4005-aff2-2edf2de44c03', 'created_at': datetime.datetime(2026, 11, 5, 3, 0, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 0, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d36926bf-e886-4005-aff2-2edf2de44c03/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab536d490>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:21 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b 1G
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5eafaa-10e5-422d-b54e-825310251f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:21 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5eafaa-10e5-422d-b54e-825310251f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1237003a-d8b5-4993-b8b5-20a9abfb1b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Volume 57e5246d-6376-4c37-b9f2-5bb83cf63cf7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7', 'volume_size': 1, 'image_id': 'd36926bf-e886-4005-aff2-2edf2de44c03', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d36926bf-e886-4005-aff2-2edf2de44c03', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e9c44743ec538bdb475695a549a188c4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd768d73fdd624573b9b6d554939c94ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5bbdffa848b615910e1145d27b17cd330688571960377bcf0df8aa646337b8ab0cc77d2b48480eaca92867d29142367726edd9a01ffaa49312f62ae7ed0426e5', 'id': 'd36926bf-e886-4005-aff2-2edf2de44c03', 'created_at': datetime.datetime(2026, 11, 5, 3, 0, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 0, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d36926bf-e886-4005-aff2-2edf2de44c03/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab536d490>}
Nov 05 04:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Trying to clone 57e5246d-6376-4c37-b9f2-5bb83cf63cf7 from image d36926bf-e886-4005-aff2-2edf2de44c03 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d36926bf-e886-4005-aff2-2edf2de44c03', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 04:00:22 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[673dcb9c-1543-4f0b-b9e0-773038cd7212]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:22 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD
Nov 05 04:00:22 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:22 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b 1G" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:22 devstack sudo[104498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b
Nov 05 04:00:22 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:22 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:22 devstack sudo[104502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD
Nov 05 04:00:22 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:22 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:22 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b is being set with open permissions: ugo+rw
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:22 devstack sudo[104507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b
Nov 05 04:00:22 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:22 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Temporary image d36926bf-e886-4005-aff2-2edf2de44c03 is fetched for user dc08732b9f8145aaa4a54cd5051e2905. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf7f7d-76dd-4fcc-baff-65ccb8dea71f]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:22 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:22 devstack sudo[104514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.info
Nov 05 04:00:22 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:22 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD
Nov 05 04:00:22 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:23 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.info" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:23 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.info is being set with open permissions: ugo+rw
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:23 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:23 devstack sudo[104520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.info
Nov 05 04:00:23 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:23 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD
Nov 05 04:00:23 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:23 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.info" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-81849369-188b-4b24-8fb2-f4aff7d46775 tempest-CinderUnicodeTest-705070389 None] Create snapshot completed successfully
Nov 05 04:00:23 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e5246d-6376-4c37-b9f2-5bb83cf63cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d768d73fdd624573b9b6d554939c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:22Z,use_quota=True,user_id='dc08732b9f8145aaa4a54cd5051e2905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Creating volume 57e5246d-6376-4c37-b9f2-5bb83cf63cf7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:23 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:23 devstack sudo[104528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 1073741824
Nov 05 04:00:23 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Acquiring lock "cinder-cf99a435-455a-4f02-ab2e-2bc68502a27b-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Lock "cinder-cf99a435-455a-4f02-ab2e-2bc68502a27b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Acquiring lock "cinder-quobyte-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Acquiring lock "cinder-quobyte-cf99a435-455a-4f02-ab2e-2bc68502a27b" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-cf99a435-455a-4f02-ab2e-2bc68502a27b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Deleting offline snapshot cf99a435-455a-4f02-ab2e-2bc68502a27b of volume 13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] snapshot_file for this snap is: volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3dba62-91d9-4b6b-9c47-cab5086b0c11]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:23 devstack sudo[104530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b
Nov 05 04:00:23 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:23 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 1073741824" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:24 devstack sudo[104535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7
Nov 05 04:00:24 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:24 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fce570-fba2-41a4-aa2a-8ad7b462a5fb]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:24 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:24 devstack sudo[104540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507
Nov 05 04:00:24 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Attempting download of d36926bf-e886-4005-aff2-2edf2de44c03 ((None, [{'url': 'file:///opt/stack/data/glance/images/d36926bf-e886-4005-aff2-2edf2de44c03', 'metadata': {}}])) to volume 57e5246d-6376-4c37-b9f2-5bb83cf63cf7. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa588093-4447-476f-bd27-642de3d72dd9]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d36926bf-e886-4005-aff2-2edf2de44c03_wbak59le {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:24 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d36926bf-e886-4005-aff2-2edf2de44c03_wbak59le
Nov 05 04:00:24 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:24 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:24 devstack sudo[104548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b
Nov 05 04:00:24 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:24 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d36926bf-e886-4005-aff2-2edf2de44c03_wbak59le" returned: 0 in 0.353s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d36926bf-e886-4005-aff2-2edf2de44c03_wbak59le {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:24 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d36926bf-e886-4005-aff2-2edf2de44c03_wbak59le
Nov 05 04:00:24 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:24 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:24 devstack sudo[104557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b
Nov 05 04:00:24 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:24 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d36926bf-e886-4005-aff2-2edf2de44c03_wbak59le" returned: 1 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d36926bf-e886-4005-aff2-2edf2de44c03_wbak59le' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7755a31-3d56-45dc-a18a-67b53e21af56]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:25 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507.cf99a435-455a-4f02-ab2e-2bc68502a27b" returned: 0 in 0.254s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:25 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD
Nov 05 04:00:25 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-cf99a435-455a-4f02-ab2e-2bc68502a27b" released by "_delete_snapshot" :: held 1.456s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" released by "delete_snapshot" :: held 1.480s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Created reservations ['8dee4717-cfbb-4d52-99c9-dc12c548c9ee', '5e58c076-0dae-4b83-bfeb-676f0a8bbb7c', 'e855380b-a84d-4d82-9881-bb0e2f05eae3', 'a5647350-6328-4c03-90c7-caee11db347b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Delete snapshot completed successfully.
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-331353c0-305a-41e9-a33a-d42b6afe3abe tempest-CinderUnicodeTest-705070389 None] Lock "cinder-cf99a435-455a-4f02-ab2e-2bc68502a27b-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:25 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:25 devstack sudo[104566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD
Nov 05 04:00:25 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:25 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] d36926bf-e886-4005-aff2-2edf2de44c03 was raw, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:25 devstack sudo[104571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7
Nov 05 04:00:25 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Acquiring lock "cinder-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Acquiring lock "cinder-quobyte-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d9ac93-4182-4fff-a54f-d7d7d7242399]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:26 devstack sudo[104576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507
Nov 05 04:00:26 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:26 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7" returned: 0 in 0.448s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d36926bf-e886-4005-aff2-2edf2de44c03_a1vfthq4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:00:26 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:26 devstack sudo[104578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 1G
Nov 05 04:00:26 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:26 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" returned: 0 in 0.366s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:26 devstack sudo[104583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507
Nov 05 04:00:26 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:26 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 1G" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Downloaded image d36926bf-e886-4005-aff2-2edf2de44c03 ((None, [{'url': 'file:///opt/stack/data/glance/images/d36926bf-e886-4005-aff2-2edf2de44c03', 'metadata': {}}])) to volume 57e5246d-6376-4c37-b9f2-5bb83cf63cf7 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Temporary image d36926bf-e886-4005-aff2-2edf2de44c03 for user dc08732b9f8145aaa4a54cd5051e2905 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Marking volume 57e5246d-6376-4c37-b9f2-5bb83cf63cf7 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Copying metadata from image d36926bf-e886-4005-aff2-2edf2de44c03 to 57e5246d-6376-4c37-b9f2-5bb83cf63cf7. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Creating volume glance metadata for volume 57e5246d-6376-4c37-b9f2-5bb83cf63cf7 backed by image d36926bf-e886-4005-aff2-2edf2de44c03 with: {'image_id': 'd36926bf-e886-4005-aff2-2edf2de44c03', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e9c44743ec538bdb475695a549a188c4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:00:26 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1237003a-d8b5-4993-b8b5-20a9abfb1b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7', 'volume_size': 1, 'image_id': 'd36926bf-e886-4005-aff2-2edf2de44c03', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d36926bf-e886-4005-aff2-2edf2de44c03', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e9c44743ec538bdb475695a549a188c4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd768d73fdd624573b9b6d554939c94ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5bbdffa848b615910e1145d27b17cd330688571960377bcf0df8aa646337b8ab0cc77d2b48480eaca92867d29142367726edd9a01ffaa49312f62ae7ed0426e5', 'id': 'd36926bf-e886-4005-aff2-2edf2de44c03', 'created_at': datetime.datetime(2026, 11, 5, 3, 0, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 0, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d36926bf-e886-4005-aff2-2edf2de44c03/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab536d490>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9a6f31-7bcc-4421-b258-7ace5ae26b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507" released by "delete_volume" :: held 0.699s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Volume volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 (57e5246d-6376-4c37-b9f2-5bb83cf63cf7): created successfully
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9a6f31-7bcc-4421-b258-7ace5ae26b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Flow 'volume_create_manager' (335d0317-bb33-44e6-8e4b-e44478f7a492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-156913cf-9014-4a1b-86fa-ba985103ad43 tempest-VolumeImageDependencyTests-1995661700 None] Created volume successfully.
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Created reservations ['216c6f59-813e-4113-94ed-f8e7ad31efaf', 'c4c03ec0-a789-4142-b4f5-7adb54955c77', 'b196a42c-9947-42d9-91d2-58ee7aaab1b3', '095cdc58-83e5-48e2-95bc-d13273086b31'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:26 devstack sudo[104589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:26 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Acquiring lock "cinder-57e5246d-6376-4c37-b9f2-5bb83cf63cf7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:26 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Deleted volume successfully.
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Lock "cinder-57e5246d-6376-4c37-b9f2-5bb83cf63cf7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Acquiring lock "cinder-522e995d-489e-4d57-a45c-343f80192235-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1aca1727-6cff-4594-a29d-64f03b0796a2 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-13cb4b9e-5e8c-4991-b1c3-bf2c7802c507-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-522e995d-489e-4d57-a45c-343f80192235-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Acquiring lock "cinder-quobyte-57e5246d-6376-4c37-b9f2-5bb83cf63cf7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Lock "cinder-quobyte-57e5246d-6376-4c37-b9f2-5bb83cf63cf7" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[27931d31-de25-4ec0-9a19-f6c1f671fc64]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Acquiring lock "cinder-quobyte-522e995d-489e-4d57-a45c-343f80192235" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-522e995d-489e-4d57-a45c-343f80192235" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa62509-22ba-4ade-99e4-44503052dea8]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:27 devstack sudo[104592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7
Nov 05 04:00:27 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:27 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235
Nov 05 04:00:27 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:27 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:27 devstack sudo[104599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7
Nov 05 04:00:27 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:27 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:27 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235
Nov 05 04:00:27 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:27 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-57e5246d-6376-4c37-b9f2-5bb83cf63cf7" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Lock "cinder-quobyte-57e5246d-6376-4c37-b9f2-5bb83cf63cf7" released by "delete_volume" :: held 0.640s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Created reservations ['bc2c1197-f4cd-4bb2-8e30-a935027b7d2d', '871e36a3-1a56-463c-af57-f77582ac1aa9', '9150187e-17fd-40dc-bff8-04729dc4785a', '60cb1284-5bad-4461-8366-284918206603'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:27 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-522e995d-489e-4d57-a45c-343f80192235" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-quobyte-522e995d-489e-4d57-a45c-343f80192235" released by "delete_volume" :: held 0.683s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:27 devstack sudo[104608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:27 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Created reservations ['2065d752-afcd-495c-baa1-6c3d2ff153b0', '3c8505fb-01b4-4713-bb66-e62082911a49', '7e91e37d-1573-4b70-9239-f296d1e754a7', 'a582f115-f207-495d-b81a-4174488e877a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:27 devstack sudo[104610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:27 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:28 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.262s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:28 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Deleted volume successfully.
Nov 05 04:00:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0d77542-9b97-4d24-b520-99c5a7d30762 tempest-VolumeImageDependencyTests-1995661700 None] Lock "cinder-57e5246d-6376-4c37-b9f2-5bb83cf63cf7-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:28 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:28 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Deleted volume successfully.
Nov 05 04:00:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-660fd3b6-a026-48cd-8331-c477d9085528 tempest-CinderUnicodeTest-705070389 None] Lock "cinder-522e995d-489e-4d57-a45c-343f80192235-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Flow 'volume_create_manager' (fffeaf83-65cc-4840-b3ef-6133cc53c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12d11ae-4814-41f0-a36a-d42cccb0836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12d11ae-4814-41f0-a36a-d42cccb0836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388741211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba26efe-6117-48e3-b223-f9b93e91ecde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc5627d209404ea335a6dc2b7c9a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:32Z,use_quota=True,user_id='27b957cebac643cc89edce61191648c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5da02d-8b69-4453-8be7-813a02dfcda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5da02d-8b69-4453-8be7-813a02dfcda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9e06db-77fe-4740-8063-688510b4b684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9e06db-77fe-4740-8063-688510b4b684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba26efe-6117-48e3-b223-f9b93e91ecde', 'volume_name': 'volume-4ba26efe-6117-48e3-b223-f9b93e91ecde', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4040ee-2978-4f00-8289-4dd8bd66fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4040ee-2978-4f00-8289-4dd8bd66fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c5e75b-3efd-485e-abcb-8dc213ef87dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:31 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Volume 4ba26efe-6117-48e3-b223-f9b93e91ecde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba26efe-6117-48e3-b223-f9b93e91ecde', 'volume_size': 1}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388741211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba26efe-6117-48e3-b223-f9b93e91ecde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc5627d209404ea335a6dc2b7c9a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:32Z,use_quota=True,user_id='27b957cebac643cc89edce61191648c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Creating volume 4ba26efe-6117-48e3-b223-f9b93e91ecde {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:31 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:32 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde 1073741824
Nov 05 04:00:32 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:32 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde 1073741824" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:32 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde
Nov 05 04:00:32 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:32 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c5e75b-3efd-485e-abcb-8dc213ef87dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba26efe-6117-48e3-b223-f9b93e91ecde', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6837177d-9c1f-4302-9d13-01821cbc7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Volume volume-4ba26efe-6117-48e3-b223-f9b93e91ecde (4ba26efe-6117-48e3-b223-f9b93e91ecde): created successfully
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6837177d-9c1f-4302-9d13-01821cbc7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Flow 'volume_create_manager' (fffeaf83-65cc-4840-b3ef-6133cc53c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-15075c7d-f7c1-4673-bf62-3f047f976f5b tempest-ProjectReaderTests-83029795 None] Created volume successfully.
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Acquiring lock "cinder-4ba26efe-6117-48e3-b223-f9b93e91ecde-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Lock "cinder-4ba26efe-6117-48e3-b223-f9b93e91ecde-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Acquiring lock "cinder-quobyte-4ba26efe-6117-48e3-b223-f9b93e91ecde" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Lock "cinder-quobyte-4ba26efe-6117-48e3-b223-f9b93e91ecde" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2916a8d3-9855-4237-b0ed-15afa2e8880a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:34 devstack sudo[104624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde
Nov 05 04:00:34 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:34 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:34 devstack sudo[104635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde
Nov 05 04:00:34 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:34 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4ba26efe-6117-48e3-b223-f9b93e91ecde" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Lock "cinder-quobyte-4ba26efe-6117-48e3-b223-f9b93e91ecde" released by "delete_volume" :: held 0.697s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Created reservations ['f6cdbb63-cce2-494e-a51a-bec4ed1eb11d', '159d0e9e-3fe0-43d0-94be-2c6707a6a8c3', 'c08ccfff-767f-435f-9cab-956101e821f2', 'd2a2e42a-4e7b-4f9d-93a0-bfc6fc26985a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:35 devstack sudo[104638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:35 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:35 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Deleted volume successfully.
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8226a60d-087d-45ea-917c-8441bafaa058 tempest-ProjectReaderTests-83029795 None] Lock "cinder-4ba26efe-6117-48e3-b223-f9b93e91ecde-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Flow 'volume_create_manager' (8d733956-4f39-4521-adb3-d6541c84c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99262ca-a511-4dca-9d9c-8814fd5458f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99262ca-a511-4dca-9d9c-8814fd5458f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584901451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936390dc-11e7-4ec5-a841-b67538eb45d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc5627d209404ea335a6dc2b7c9a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:36Z,use_quota=True,user_id='27b957cebac643cc89edce61191648c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9473dd57-74c0-4d0d-9798-0c360780c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9473dd57-74c0-4d0d-9798-0c360780c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948cf29-99c4-437a-9344-f665f40457f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948cf29-99c4-437a-9344-f665f40457f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936390dc-11e7-4ec5-a841-b67538eb45d2', 'volume_name': 'volume-936390dc-11e7-4ec5-a841-b67538eb45d2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4c37cb-3a7f-405b-aca4-f7dd65290ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4c37cb-3a7f-405b-aca4-f7dd65290ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ecef07-ec43-41f5-bf19-7f79e419afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Volume 936390dc-11e7-4ec5-a841-b67538eb45d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936390dc-11e7-4ec5-a841-b67538eb45d2', 'volume_size': 1}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584901451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936390dc-11e7-4ec5-a841-b67538eb45d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc5627d209404ea335a6dc2b7c9a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:36Z,use_quota=True,user_id='27b957cebac643cc89edce61191648c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Creating volume 936390dc-11e7-4ec5-a841-b67538eb45d2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:36 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:36 devstack sudo[104641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2 1073741824
Nov 05 04:00:36 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:36 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2 1073741824" returned: 0 in 0.503s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:36 devstack sudo[104647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2
Nov 05 04:00:36 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:36 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ecef07-ec43-41f5-bf19-7f79e419afcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936390dc-11e7-4ec5-a841-b67538eb45d2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068c3d11-f28c-4e05-84af-b8f9bb9c3df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Volume volume-936390dc-11e7-4ec5-a841-b67538eb45d2 (936390dc-11e7-4ec5-a841-b67538eb45d2): created successfully
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068c3d11-f28c-4e05-84af-b8f9bb9c3df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Flow 'volume_create_manager' (8d733956-4f39-4521-adb3-d6541c84c85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2e0461b9-8976-4944-9997-9a22ee4cd8fc tempest-ProjectReaderTests-83029795 None] Created volume successfully.
Nov 05 04:00:36 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=116,cinder:INSERT=52,cinder:UPDATE=140,cinder:DELETE=14 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Acquiring lock "cinder-936390dc-11e7-4ec5-a841-b67538eb45d2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Lock "cinder-936390dc-11e7-4ec5-a841-b67538eb45d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=158,cinder:SELECT=126,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Acquiring lock "cinder-quobyte-936390dc-11e7-4ec5-a841-b67538eb45d2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Lock "cinder-quobyte-936390dc-11e7-4ec5-a841-b67538eb45d2" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adf9b66-539e-4944-98bd-419bc1a14624]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:38 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2
Nov 05 04:00:38 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:38 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2" returned: 0 in 0.460s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:38 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2
Nov 05 04:00:38 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:38 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-936390dc-11e7-4ec5-a841-b67538eb45d2" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Lock "cinder-quobyte-936390dc-11e7-4ec5-a841-b67538eb45d2" released by "delete_volume" :: held 0.817s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Created reservations ['c0cb2820-d783-452c-8a20-c8b94fa6f991', '7604d489-56e8-4a9f-84ab-8217f1f70ead', '902ee08b-64a6-4343-9c2f-8ef3e3eaacb3', '7c3c5db9-b2a8-42b4-8865-512de3ac0d53'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:39 devstack sudo[104658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:00:39 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:39 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.323s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Deleted volume successfully.
Nov 05 04:00:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf86ff3d-58db-4451-9df9-d00ddb5349a3 tempest-ProjectReaderTests-83029795 None] Lock "cinder-936390dc-11e7-4ec5-a841-b67538eb45d2-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:00:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Flow 'volume_create_manager' (0e72aed5-36b7-4e99-87fc-643994d320b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245b3e39-c38f-4e2a-bba5-330a7a83c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245b3e39-c38f-4e2a-bba5-330a7a83c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1716720555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4097e837-a0a2-4bd5-b293-0b5bb5d14374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c99cf173c14b54accdb29dd054a0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:54Z,use_quota=True,user_id='0a29c311a4ec48cd8b069f07533df711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6adc78-4e5c-4877-b97c-f757f64f87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6adc78-4e5c-4877-b97c-f757f64f87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0de5b7-fc5a-402c-a983-4ecfddabbe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0de5b7-fc5a-402c-a983-4ecfddabbe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4097e837-a0a2-4bd5-b293-0b5bb5d14374', 'volume_name': 'volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac609e38-c17b-4c57-b34d-849d22584a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac609e38-c17b-4c57-b34d-849d22584a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb85c426-1b93-48b1-9602-fea7c59c8401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Volume 4097e837-a0a2-4bd5-b293-0b5bb5d14374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374', 'volume_size': 1}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1716720555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4097e837-a0a2-4bd5-b293-0b5bb5d14374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c99cf173c14b54accdb29dd054a0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:54Z,use_quota=True,user_id='0a29c311a4ec48cd8b069f07533df711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Creating volume 4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:54 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:54 devstack sudo[104701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 1073741824
Nov 05 04:00:54 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:54 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 1073741824" returned: 0 in 0.511s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:55 devstack sudo[104706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374
Nov 05 04:00:55 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:55 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374" returned: 0 in 0.265s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb85c426-1b93-48b1-9602-fea7c59c8401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82779bfc-a38b-4fb9-a251-b1f44506c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Volume volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 (4097e837-a0a2-4bd5-b293-0b5bb5d14374): created successfully
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82779bfc-a38b-4fb9-a251-b1f44506c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Flow 'volume_create_manager' (0e72aed5-36b7-4e99-87fc-643994d320b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9725b558-46a2-4679-8e61-8a8407a13739 tempest-SnapshotDependencyTests-799124212 None] Created volume successfully.
Nov 05 04:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Creating offline snapshot 5f0f6bb8-7c05-4460-a457-e7abae96c35d of volume 4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:00:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a382672b-60c2-4834-9005-4271ebf5c2c1]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:56 devstack sudo[104709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374
Nov 05 04:00:56 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:57 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:57 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d 1G
Nov 05 04:00:57 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:57 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d 1G" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:57 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d
Nov 05 04:00:57 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:57 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:57 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d is being set with open permissions: ugo+rw
Nov 05 04:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:57 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d
Nov 05 04:00:57 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:57 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:58 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.info
Nov 05 04:00:58 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:58 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.info" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:58 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.info is being set with open permissions: ugo+rw
Nov 05 04:00:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:58 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.info
Nov 05 04:00:58 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:58 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.info" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9a87b5c5-db46-4abc-8708-64e1b0aded09 tempest-SnapshotDependencyTests-799124212 None] Create snapshot completed successfully
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Flow 'volume_create_manager' (6641eff6-0d5e-4bea-a3e3-1732c6f95375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1e6e1c-86d6-489f-86b3-4bf89186384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1e6e1c-86d6-489f-86b3-4bf89186384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0bed2d-8fa9-42ae-8220-4effcd9c47d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c99cf173c14b54accdb29dd054a0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f0f6bb8-7c05-4460-a457-e7abae96c35d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:59Z,use_quota=True,user_id='0a29c311a4ec48cd8b069f07533df711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aa1caa-2b8e-448a-9e93-835bd77626c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aa1caa-2b8e-448a-9e93-835bd77626c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e455c4cc-5fd1-4194-84fb-7e99101e6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e455c4cc-5fd1-4194-84fb-7e99101e6e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b0bed2d-8fa9-42ae-8220-4effcd9c47d2', 'volume_name': 'volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2', 'volume_size': 1, 'snapshot_id': '5f0f6bb8-7c05-4460-a457-e7abae96c35d'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab09e71-b244-47f7-b908-694ca096600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab09e71-b244-47f7-b908-694ca096600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f021a599-5df4-440b-8fc7-fb92b7708b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:00:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Volume 4b0bed2d-8fa9-42ae-8220-4effcd9c47d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2', 'volume_size': 1, 'snapshot_id': '5f0f6bb8-7c05-4460-a457-e7abae96c35d'}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-quobyte-5f0f6bb8-7c05-4460-a457-e7abae96c35d-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-5f0f6bb8-7c05-4460-a457-e7abae96c35d-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Creating volume 4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 from snapshot 5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-quobyte-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] snapshot: 5f0f6bb8-7c05-4460-a457-e7abae96c35d, volume: 4b0bed2d-8fa9-42ae-8220-4effcd9c47d2,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9efd49-b1d3-41e0-a03a-fe0347236860]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:59 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d
Nov 05 04:00:59 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:59 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf37d5-ec49-4c62-8923-610bb63c71d4]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:00 devstack sudo[104739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374
Nov 05 04:01:00 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:00 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 04:01:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 04:01:00 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:01:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:00 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2
Nov 05 04:01:00 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:05 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" returned: 0 in 5.538s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:05 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:01:05 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Converted 1024.00 MB image at 184.87 MB/s
Nov 05 04:01:05 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 is being set with open permissions: ugo+rw
Nov 05 04:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:05 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2
Nov 05 04:01:05 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:06 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" released by "_copy_volume_from_snapshot" :: held 6.640s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-5f0f6bb8-7c05-4460-a457-e7abae96c35d-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" released by "_create_volume_from_snapshot" :: held 6.697s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.713s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f021a599-5df4-440b-8fc7-fb92b7708b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2', 'volume_size': 1, 'snapshot_id': '5f0f6bb8-7c05-4460-a457-e7abae96c35d'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cdb1c3-0169-455c-864a-5e62582dfe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Volume volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 (4b0bed2d-8fa9-42ae-8220-4effcd9c47d2): created successfully
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cdb1c3-0169-455c-864a-5e62582dfe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Flow 'volume_create_manager' (6641eff6-0d5e-4bea-a3e3-1732c6f95375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b4461756-d5d6-4200-9da5-d33fab49b521 tempest-SnapshotDependencyTests-799124212 None] Created volume successfully.
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-5f0f6bb8-7c05-4460-a457-e7abae96c35d-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-5f0f6bb8-7c05-4460-a457-e7abae96c35d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-quobyte-4097e837-a0a2-4bd5-b293-0b5bb5d14374" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4097e837-a0a2-4bd5-b293-0b5bb5d14374" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-quobyte-5f0f6bb8-7c05-4460-a457-e7abae96c35d" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-5f0f6bb8-7c05-4460-a457-e7abae96c35d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Deleting offline snapshot 5f0f6bb8-7c05-4460-a457-e7abae96c35d of volume 4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] snapshot_file for this snap is: volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a71c6-5766-475f-8ac0-69190a86bb00]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:07 devstack sudo[104761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d
Nov 05 04:01:07 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:07 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d" returned: 0 in 0.360s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:01:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f8b18f-4d37-4c58-a482-04eb87da459c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:07 devstack sudo[104766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374
Nov 05 04:01:07 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:07 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374" returned: 0 in 0.507s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:07 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d
Nov 05 04:01:07 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:08 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:08 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d
Nov 05 04:01:08 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:08 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374.5f0f6bb8-7c05-4460-a457-e7abae96c35d" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-5f0f6bb8-7c05-4460-a457-e7abae96c35d" released by "_delete_snapshot" :: held 1.540s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4097e837-a0a2-4bd5-b293-0b5bb5d14374" released by "delete_snapshot" :: held 1.565s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Created reservations ['3dfdf85d-bdbd-4ee3-91fb-b185cbbb0652', '854355b8-385b-4e6d-87aa-a64511003fb8', '5b2ed686-452f-47ff-9f93-b35f235b229c', 'bfb61d23-b835-4ab1-a597-35e4169b9c78'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Delete snapshot completed successfully.
Nov 05 04:01:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f416ca9d-2d81-47f4-afc6-5590adacb031 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-5f0f6bb8-7c05-4460-a457-e7abae96c35d-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-4097e837-a0a2-4bd5-b293-0b5bb5d14374-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-4097e837-a0a2-4bd5-b293-0b5bb5d14374-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-quobyte-4097e837-a0a2-4bd5-b293-0b5bb5d14374" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4097e837-a0a2-4bd5-b293-0b5bb5d14374" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[579b8fe4-3eb0-459c-8ba5-6c2e5109600c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:09 devstack sudo[104780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374
Nov 05 04:01:09 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:09 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:09 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374
Nov 05 04:01:09 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:09 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4097e837-a0a2-4bd5-b293-0b5bb5d14374" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4097e837-a0a2-4bd5-b293-0b5bb5d14374" released by "delete_volume" :: held 0.663s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Created reservations ['7662709a-891f-4bd5-8a3f-cedd0da87751', 'dbd9fa15-198c-4ce8-874d-0bcfe1fa6d85', '95f109a9-c6ae-4c1d-a3e5-75fa4e586233', 'a917b4e0-735c-4648-a1bb-8712f05b9d9b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:09 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:09 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:10 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Deleted volume successfully.
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b349eef6-96bf-48a2-b34e-ca915f5eb08d tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-4097e837-a0a2-4bd5-b293-0b5bb5d14374-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "cinder-quobyte-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea7f3e-a1e2-4616-bf56-cffe02d4ec8b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:10 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2
Nov 05 04:01:10 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:10 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:10 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:10 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" returned: 0 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:10 devstack sudo[104799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2
Nov 05 04:01:10 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:10 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 04:01:10 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" returned: 0 in 0.237s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-quobyte-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2" released by "delete_volume" :: held 0.641s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Created reservations ['5435ce03-7f3e-486f-90b4-00679539147d', '62cf52a1-2079-4a1e-b50c-cd5d077bd74a', '6fb7a624-aa99-4db3-9ef7-b65b5bcdc5c1', 'f651b51b-1830-4419-8ce1-e9d018248f63'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:11 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:11 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:11 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Deleted volume successfully.
Nov 05 04:01:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-323cea94-35ea-445f-b88b-2c83a9889095 tempest-SnapshotDependencyTests-799124212 None] Lock "cinder-4b0bed2d-8fa9-42ae-8220-4effcd9c47d2-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:21 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:01:21 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=30,cinder:INSERT=7,cinder:SELECT=27,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Flow 'volume_create_manager' (128fa641-7780-40e1-bb64-155a956f78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd68f999-0aea-4e97-82ff-276cf9f46e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd68f999-0aea-4e97-82ff-276cf9f46e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-142969840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f23e81c-2669-4707-a51b-56903bc51e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e561bb91462491093870acbbae3514c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:33Z,use_quota=True,user_id='10e4d4af109f45d7917fb61643c23ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1bd43b-8143-4682-a8a6-19c5d3fd21c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1bd43b-8143-4682-a8a6-19c5d3fd21c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d616ff-9067-4f4d-88b6-f0f27ea2afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d616ff-9067-4f4d-88b6-f0f27ea2afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f23e81c-2669-4707-a51b-56903bc51e1f', 'volume_name': 'volume-4f23e81c-2669-4707-a51b-56903bc51e1f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df2a7f7-4e26-454c-ae03-5c1bba85edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df2a7f7-4e26-454c-ae03-5c1bba85edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f634f8-d1b8-4697-af5f-39d07767111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Volume 4f23e81c-2669-4707-a51b-56903bc51e1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f23e81c-2669-4707-a51b-56903bc51e1f', 'volume_size': 1}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-142969840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f23e81c-2669-4707-a51b-56903bc51e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e561bb91462491093870acbbae3514c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:33Z,use_quota=True,user_id='10e4d4af109f45d7917fb61643c23ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Creating volume 4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:33 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f 1073741824
Nov 05 04:01:33 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (1532d3f5-1724-4119-8326-901682a64359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc74f6df-9e4d-4a12-90f2-8911b2a7f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc74f6df-9e4d-4a12-90f2-8911b2a7f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131054540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c21756-ff5c-4705-a84b-90be38e883a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:33Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbca991-b431-4ba4-b085-e50475d01928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbca991-b431-4ba4-b085-e50475d01928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afe7216-1f1f-4dd7-ba2c-ef0b5e0501ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afe7216-1f1f-4dd7-ba2c-ef0b5e0501ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c21756-ff5c-4705-a84b-90be38e883a1', 'volume_name': 'volume-80c21756-ff5c-4705-a84b-90be38e883a1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cf5955-0c1d-48f6-8055-eb325af90166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cf5955-0c1d-48f6-8055-eb325af90166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f1f44-c7d8-4c34-bf78-6242490322a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume 80c21756-ff5c-4705-a84b-90be38e883a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c21756-ff5c-4705-a84b-90be38e883a1', 'volume_size': 1}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:33 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f 1073741824" returned: 0 in 0.605s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:33 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f
Nov 05 04:01:33 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:34 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131054540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c21756-ff5c-4705-a84b-90be38e883a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:33Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Creating volume 80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:34 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f634f8-d1b8-4697-af5f-39d07767111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f23e81c-2669-4707-a51b-56903bc51e1f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:34 devstack sudo[104861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 1073741824
Nov 05 04:01:34 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3abc55-6a95-47d9-9220-b0730f47fd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Volume volume-4f23e81c-2669-4707-a51b-56903bc51e1f (4f23e81c-2669-4707-a51b-56903bc51e1f): created successfully
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3abc55-6a95-47d9-9220-b0730f47fd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Flow 'volume_create_manager' (128fa641-7780-40e1-bb64-155a956f78d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-73a2520c-d934-40a3-a512-b29ed86a42aa tempest-VolumeDependencyTests-1916663251 None] Created volume successfully.
Nov 05 04:01:34 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 1073741824" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:34 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1
Nov 05 04:01:34 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:35 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f1f44-c7d8-4c34-bf78-6242490322a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c21756-ff5c-4705-a84b-90be38e883a1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6bd264-20d2-421f-87b6-9478b489c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume volume-80c21756-ff5c-4705-a84b-90be38e883a1 (80c21756-ff5c-4705-a84b-90be38e883a1): created successfully
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6bd264-20d2-421f-87b6-9478b489c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (1532d3f5-1724-4119-8326-901682a64359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-55789841-1f70-442f-bdb2-6b75160deeb1 tempest-CreateVolumesFromSnapshotTest-32659150 None] Created volume successfully.
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Creating offline snapshot ea9a4edf-701f-40ca-86d3-9c9e82738ba7 of volume 4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[220d892d-555f-47e5-ab23-586f600568a3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:35 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f
Nov 05 04:01:35 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:35 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f" returned: 0 in 0.492s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:35 devstack sudo[104880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 1G
Nov 05 04:01:35 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Flow 'volume_create_manager' (8bc00439-7bd7-4faa-a3d3-e4dec1630430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de98002-e308-48ea-b262-2607f64fe866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de98002-e308-48ea-b262-2607f64fe866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00d8414-bb3e-42ba-8233-078188245302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba20815c2cc47068bd4742b8be1c736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:36Z,use_quota=True,user_id='382523c4f77a405a916a5317dfc7a2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdd5524-0aa6-43dd-beeb-aee5fb4fff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdd5524-0aa6-43dd-beeb-aee5fb4fff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a62b561-5b2c-43d3-af3e-37d69bffc4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:01:36 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 1G" returned: 0 in 0.550s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f23e81c-2669-4707-a51b-56903bc51e1f -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:36 devstack sudo[104887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f23e81c-2669-4707-a51b-56903bc51e1f -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7
Nov 05 04:01:36 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a62b561-5b2c-43d3-af3e-37d69bffc4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f00d8414-bb3e-42ba-8233-078188245302', 'volume_name': 'volume-f00d8414-bb3e-42ba-8233-078188245302', 'volume_size': 1, 'image_id': '9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e241367b1af564c6dde73b0803ee308e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eba20815c2cc47068bd4742b8be1c736', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59ded09c5f877509124e45e0cec3a1643de2f87f5b80f091f167f75a5ff7e71d674a1c2bd9331b64eb0dddfe92c1c217ac918a12bcc8600dab592781d9e700c9', 'id': '9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab54ca990>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924efce1-84ab-481b-8b04-19a5d984345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924efce1-84ab-481b-8b04-19a5d984345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1916fe-6b2d-48b7-8006-1f6f65d6258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Volume f00d8414-bb3e-42ba-8233-078188245302: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f00d8414-bb3e-42ba-8233-078188245302', 'volume_size': 1, 'image_id': '9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e241367b1af564c6dde73b0803ee308e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eba20815c2cc47068bd4742b8be1c736', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59ded09c5f877509124e45e0cec3a1643de2f87f5b80f091f167f75a5ff7e71d674a1c2bd9331b64eb0dddfe92c1c217ac918a12bcc8600dab592781d9e700c9', 'id': '9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab54ca990>}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Trying to clone f00d8414-bb3e-42ba-8233-078188245302 from image 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 04:01:36 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86788da-ee61-4043-9cf3-2810d8321498]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:36 devstack sudo[104889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD
Nov 05 04:01:36 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:36 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f23e81c-2669-4707-a51b-56903bc51e1f -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:36 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 is being set with open permissions: ugo+rw
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:36 devstack sudo[104894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7
Nov 05 04:01:36 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:36 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:37 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:37 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD
Nov 05 04:01:37 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:37 devstack sudo[104901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.info
Nov 05 04:01:37 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Flow 'volume_create_manager' (9fb86f7b-2761-4bac-bf3f-14fc993bc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e252c84c-567c-4bf5-a70a-8717ec3e48c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e252c84c-567c-4bf5-a70a-8717ec3e48c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17791c1f-d925-4ce5-81c8-96826e852a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6159545d61e04f748400399ec8db0526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:37Z,use_quota=True,user_id='24873c719da54142b33e1afb582b152f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07219723-3810-46fb-83cc-52628fd86f73),volume_type_id=07219723-3810-46fb-83cc-52628fd86f73)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67668402-521b-478f-825e-8ba331a9fc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67668402-521b-478f-825e-8ba331a9fc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efce929-2440-4417-a79d-3b48891a1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:01:37 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Temporary image 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 is fetched for user 382523c4f77a405a916a5317dfc7a2de. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e805e6dc-3584-4aa3-a77c-21a748963b98]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:37 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.info" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:37 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.info is being set with open permissions: ugo+rw
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:37 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.info
Nov 05 04:01:37 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:37 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efce929-2440-4417-a79d-3b48891a1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17791c1f-d925-4ce5-81c8-96826e852a23', 'volume_name': 'volume-17791c1f-d925-4ce5-81c8-96826e852a23', 'volume_size': 1, 'image_id': 'fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69de1dc6d91f4bc4e2ea9fb576f99abf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6159545d61e04f748400399ec8db0526', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc13c6a6bab59ab0184533f9c928518911a8c60271ec655e2d0630998fa161e73b48ab5afa023d9188a6b04b11775a84edf430ae45a385c8aaf7d2705891e23d', 'id': 'fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9aaaff53a0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:37 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85323913-147e-47ab-833a-7bd64293d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85323913-147e-47ab-833a-7bd64293d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31e33c6-bd86-430d-a579-9be059b9510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Volume 17791c1f-d925-4ce5-81c8-96826e852a23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17791c1f-d925-4ce5-81c8-96826e852a23', 'volume_size': 1, 'image_id': 'fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69de1dc6d91f4bc4e2ea9fb576f99abf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6159545d61e04f748400399ec8db0526', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc13c6a6bab59ab0184533f9c928518911a8c60271ec655e2d0630998fa161e73b48ab5afa023d9188a6b04b11775a84edf430ae45a385c8aaf7d2705891e23d', 'id': 'fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9aaaff53a0>}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Trying to clone 17791c1f-d925-4ce5-81c8-96826e852a23 from image fa27788c-b0ff-4842-9dcf-90a65fc07ecc at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 04:01:37 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:01:37 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b715153-707d-4b3e-abb1-dcd60a1d385f]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.info" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.262s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Creating offline snapshot 902b3d44-7c99-41ee-8011-3700d4751e3a of volume 80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:01:37 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-536f64c3-ba31-4154-b821-08a310362b51 tempest-VolumeDependencyTests-1916663251 None] Create snapshot completed successfully
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[544fb5f1-2f92-4047-85cd-386bfa294d8f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:37 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD
Nov 05 04:01:37 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:37 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD
Nov 05 04:01:37 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:37 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1
Nov 05 04:01:37 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:38 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:38 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:38 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:38 devstack sudo[104922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:38 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:38 devstack sudo[104930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a 1G
Nov 05 04:01:38 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:38 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Temporary image fa27788c-b0ff-4842-9dcf-90a65fc07ecc is fetched for user 24873c719da54142b33e1afb582b152f. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cef835-b9e7-4828-ac73-c2ec93b86bd9]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:38 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a 1G" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c21756-ff5c-4705-a84b-90be38e883a1 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:38 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD
Nov 05 04:01:38 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:38 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c21756-ff5c-4705-a84b-90be38e883a1 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a
Nov 05 04:01:38 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:38 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:38 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:38 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c21756-ff5c-4705-a84b-90be38e883a1 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a" returned: 0 in 0.384s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:39 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a is being set with open permissions: ugo+rw
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:39 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD
Nov 05 04:01:39 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Flow 'volume_create_manager' (44ee432a-f5d9-49be-91b3-855616e26877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa60a4d2-157c-4f5d-8c6e-4a42cfe32a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:39 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a
Nov 05 04:01:39 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa60a4d2-157c-4f5d-8c6e-4a42cfe32a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-968216391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559de328-9bbc-4743-b87f-ad5a6648f26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e561bb91462491093870acbbae3514c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea9a4edf-701f-40ca-86d3-9c9e82738ba7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:39Z,use_quota=True,user_id='10e4d4af109f45d7917fb61643c23ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a51d29-e729-4b27-9124-384ad0c9af6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a51d29-e729-4b27-9124-384ad0c9af6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8850dd70-165c-45a5-86d8-6b56d660071b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8850dd70-165c-45a5-86d8-6b56d660071b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '559de328-9bbc-4743-b87f-ad5a6648f26b', 'volume_name': 'volume-559de328-9bbc-4743-b87f-ad5a6648f26b', 'volume_size': 1, 'snapshot_id': 'ea9a4edf-701f-40ca-86d3-9c9e82738ba7'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad3d23-aaf2-4a9f-a3a0-a83b9bdfa7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad3d23-aaf2-4a9f-a3a0-a83b9bdfa7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adc667b-118d-4ce1-ae37-03cd6774455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:39 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Volume 559de328-9bbc-4743-b87f-ad5a6648f26b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-559de328-9bbc-4743-b87f-ad5a6648f26b', 'volume_size': 1, 'snapshot_id': 'ea9a4edf-701f-40ca-86d3-9c9e82738ba7'}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:39 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:39 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:39 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.info
Nov 05 04:01:39 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:39 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.info" returned: 0 in 0.290s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:39 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.info is being set with open permissions: ugo+rw
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:39 devstack sudo[104962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.info
Nov 05 04:01:39 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:39 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.info" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00d8414-bb3e-42ba-8233-078188245302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba20815c2cc47068bd4742b8be1c736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:36Z,use_quota=True,user_id='382523c4f77a405a916a5317dfc7a2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Creating volume f00d8414-bb3e-42ba-8233-078188245302 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:39 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:39 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 1073741824
Nov 05 04:01:39 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a9490a6d-1ea5-4552-ae8c-fbbfeec33088 tempest-CreateVolumesFromSnapshotTest-32659150 None] Create snapshot completed successfully
Nov 05 04:01:40 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 1073741824" returned: 0 in 0.482s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:40 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302
Nov 05 04:01:40 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:40 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.594s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-quobyte-ea9a4edf-701f-40ca-86d3-9c9e82738ba7-559de328-9bbc-4743-b87f-ad5a6648f26b" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-ea9a4edf-701f-40ca-86d3-9c9e82738ba7-559de328-9bbc-4743-b87f-ad5a6648f26b" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Creating volume 559de328-9bbc-4743-b87f-ad5a6648f26b from snapshot ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-quobyte-559de328-9bbc-4743-b87f-ad5a6648f26b" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Attempting download of 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'metadata': {}}])) to volume f00d8414-bb3e-42ba-8233-078188245302. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-559de328-9bbc-4743-b87f-ad5a6648f26b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] snapshot: ea9a4edf-701f-40ca-86d3-9c9e82738ba7, volume: 559de328-9bbc-4743-b87f-ad5a6648f26b,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f06fef-1228-43a2-b112-014afdc2cefe]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda203df-8106-4fcb-a9e9-248f1d456025]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_kw4_h3fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:41 devstack sudo[104974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_kw4_h3fa
Nov 05 04:01:41 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:41 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7
Nov 05 04:01:41 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (57c09846-25bd-48f4-af0d-485d12f9757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e76683-6c4a-43c6-9fe8-9a2197a53450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e76683-6c4a-43c6-9fe8-9a2197a53450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753835718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c035895-4299-4d7d-b5d2-a6df2c9c8349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:41Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5781f749-395b-4007-8fda-1bc526435580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5781f749-395b-4007-8fda-1bc526435580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fd2098-809a-4334-b746-fcc6993c8e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fd2098-809a-4334-b746-fcc6993c8e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c035895-4299-4d7d-b5d2-a6df2c9c8349', 'volume_name': 'volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc51ab13-9cda-4015-bd79-f00de62d6155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc51ab13-9cda-4015-bd79-f00de62d6155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84051ccb-ad51-41d3-a38f-f02be9cd324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume 3c035895-4299-4d7d-b5d2-a6df2c9c8349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349', 'volume_size': 1}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:41 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_kw4_h3fa" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_kw4_h3fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:41 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7" returned: 0 in 0.584s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f23e81c-2669-4707-a51b-56903bc51e1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46882f-0049-4d02-9fdb-9d98d2c466de]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:41 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_kw4_h3fa
Nov 05 04:01:41 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:41 devstack sudo[104983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f
Nov 05 04:01:41 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (f368466c-311e-4135-9850-a6b0ad0a0bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8903e600-581f-4048-96c2-073e7982ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8903e600-581f-4048-96c2-073e7982ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376340546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90299c0-0829-4718-afc8-3e36562add5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:42Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ddf85f-46d7-43ca-8691-57fd8084fbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ddf85f-46d7-43ca-8691-57fd8084fbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21488176-deeb-4487-ab0b-56808fdf0f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21488176-deeb-4487-ab0b-56808fdf0f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90299c0-0829-4718-afc8-3e36562add5b', 'volume_name': 'volume-b90299c0-0829-4718-afc8-3e36562add5b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f47fb7a-5217-41eb-ba86-1e63dabea4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f47fb7a-5217-41eb-ba86-1e63dabea4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083455be-aecc-446b-bf00-316c12ee91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume b90299c0-0829-4718-afc8-3e36562add5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90299c0-0829-4718-afc8-3e36562add5b', 'volume_size': 1}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_kw4_h3fa" returned: 1 in 0.524s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_kw4_h3fa' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5366e8ad-2ee7-4319-96f3-3b78d01e713d]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:42 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:42 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD
Nov 05 04:01:42 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f" returned: 0 in 0.539s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:42 devstack sudo[104994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b
Nov 05 04:01:42 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (e8bc8a37-db24-47b4-9179-b5f4768953ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e53630-1a87-487e-8177-044a2338697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e53630-1a87-487e-8177-044a2338697f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088881592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280d3bce-4bcc-419b-9f0c-ba47cb7c1772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:42Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205aaa0b-8b40-4ce7-809b-f311e6b50fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205aaa0b-8b40-4ce7-809b-f311e6b50fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133ac8a-6d6f-4351-b63e-81d85cfe3bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133ac8a-6d6f-4351-b63e-81d85cfe3bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280d3bce-4bcc-419b-9f0c-ba47cb7c1772', 'volume_name': 'volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b61c387-ae3b-41c4-9d09-547d3bcb08bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b61c387-ae3b-41c4-9d09-547d3bcb08bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deaa01d-9ad2-4cd9-a2ea-c205f3925db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume 280d3bce-4bcc-419b-9f0c-ba47cb7c1772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772', 'volume_size': 1}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:42 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:42 devstack sudo[105000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD
Nov 05 04:01:42 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (bbc8f101-8559-462b-a8c5-c3288e143b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2edb5e4-e979-4068-9857-beafab756287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2edb5e4-e979-4068-9857-beafab756287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020104812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc9216-88e1-4feb-a475-455c6b9e6d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:42Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862036c8-4a79-4b41-ab53-0e995b5d8671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862036c8-4a79-4b41-ab53-0e995b5d8671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff7f427-bc2c-427a-8e40-b265bd1a147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff7f427-bc2c-427a-8e40-b265bd1a147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58dc9216-88e1-4feb-a475-455c6b9e6d06', 'volume_name': 'volume-58dc9216-88e1-4feb-a475-455c6b9e6d06', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a9ed8-8760-41b8-abf7-6b2fa4971220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a9ed8-8760-41b8-abf7-6b2fa4971220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da1bb10-4849-4cbb-a8b2-01f9aa5b77be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume 58dc9216-88e1-4feb-a475-455c6b9e6d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58dc9216-88e1-4feb-a475-455c6b9e6d06', 'volume_size': 1}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:42 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD" returned: 1 in 0.547s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 was raw, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 04:01:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:42 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302
Nov 05 04:01:42 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (faea20cf-a9f7-4a5e-8fc9-a00b19a635db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ca8e3c-d011-4396-8fda-adf895666b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ca8e3c-d011-4396-8fda-adf895666b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518091602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f0ab6b-e8e5-4047-be10-9af4f7626659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:43Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cd01c3-ccae-48b9-8dc1-d4cb88a702d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cd01c3-ccae-48b9-8dc1-d4cb88a702d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79178dc3-d491-45b4-a372-c74df9fd02d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79178dc3-d491-45b4-a372-c74df9fd02d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f0ab6b-e8e5-4047-be10-9af4f7626659', 'volume_name': 'volume-55f0ab6b-e8e5-4047-be10-9af4f7626659', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7fa529-efaf-4e15-b54b-bb3d0b047f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7fa529-efaf-4e15-b54b-bb3d0b047f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88e48c4-1147-4b93-8da9-20e1b5b99409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume 55f0ab6b-e8e5-4047-be10-9af4f7626659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f0ab6b-e8e5-4047-be10-9af4f7626659', 'volume_size': 1}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:43 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302" returned: 0 in 0.993s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7_vp9kqhjqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:01:43 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:01:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:43 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 1G
Nov 05 04:01:43 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:44 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 1G" returned: 0 in 0.539s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Downloaded image 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'metadata': {}}])) to volume f00d8414-bb3e-42ba-8233-078188245302 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Temporary image 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 for user 382523c4f77a405a916a5317dfc7a2de is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Marking volume f00d8414-bb3e-42ba-8233-078188245302 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Copying metadata from image 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 to f00d8414-bb3e-42ba-8233-078188245302. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Creating volume glance metadata for volume f00d8414-bb3e-42ba-8233-078188245302 backed by image 9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7 with: {'image_id': '9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e241367b1af564c6dde73b0803ee308e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1916fe-6b2d-48b7-8006-1f6f65d6258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00d8414-bb3e-42ba-8233-078188245302', 'volume_size': 1, 'image_id': '9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e241367b1af564c6dde73b0803ee308e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eba20815c2cc47068bd4742b8be1c736', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59ded09c5f877509124e45e0cec3a1643de2f87f5b80f091f167f75a5ff7e71d674a1c2bd9331b64eb0dddfe92c1c217ac918a12bcc8600dab592781d9e700c9', 'id': '9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d0c3964-3fe4-48f9-ac9b-5a9ed64801a7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9ab54ca990>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94dc4ed-4eaa-4762-af0b-5aa6e011a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:44 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Volume volume-f00d8414-bb3e-42ba-8233-078188245302 (f00d8414-bb3e-42ba-8233-078188245302): created successfully
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94dc4ed-4eaa-4762-af0b-5aa6e011a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Flow 'volume_create_manager' (8bc00439-7bd7-4faa-a3d3-e4dec1630430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:44 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f34df550-6f93-483a-9f8f-b9bb03492693 tempest-VolumeImageDependencyTests-353747318 None] Created volume successfully.
Nov 05 04:01:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Acquiring lock "cinder-f00d8414-bb3e-42ba-8233-078188245302-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Lock "cinder-f00d8414-bb3e-42ba-8233-078188245302-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Acquiring lock "cinder-quobyte-f00d8414-bb3e-42ba-8233-078188245302" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Lock "cinder-quobyte-f00d8414-bb3e-42ba-8233-078188245302" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e5ee35-10dd-422d-8e87-5e8a992b4e57]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:46 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302
Nov 05 04:01:46 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:46 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302" returned: 0 in 0.692s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:46 devstack sudo[105067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302
Nov 05 04:01:46 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:47 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-f00d8414-bb3e-42ba-8233-078188245302" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Lock "cinder-quobyte-f00d8414-bb3e-42ba-8233-078188245302" released by "delete_volume" :: held 1.218s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Created reservations ['021519f4-4212-4880-926d-6b6506925e6d', '032e6a9b-dac2-457a-a5ef-5304c4a4f172', 'e906bb71-2f69-4ddb-916b-87a54902d8c0', '0f44e8fa-2136-4c85-b1cc-6eb944996d08'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:47 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:47 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:47 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Deleted volume successfully.
Nov 05 04:01:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3b7d629d-ba1b-4e22-9b35-5d31bad67a71 tempest-VolumeImageDependencyTests-353747318 None] Lock "cinder-f00d8414-bb3e-42ba-8233-078188245302-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:49 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b" returned: 0 in 7.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:01:49 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Converted 1024.00 MB image at 141.29 MB/s
Nov 05 04:01:49 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b is being set with open permissions: ugo+rw
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:49 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b
Nov 05 04:01:49 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:49 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-559de328-9bbc-4743-b87f-ad5a6648f26b" released by "_copy_volume_from_snapshot" :: held 8.747s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-ea9a4edf-701f-40ca-86d3-9c9e82738ba7-559de328-9bbc-4743-b87f-ad5a6648f26b" released by "_create_volume_from_snapshot" :: held 8.833s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.864s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.337s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17791c1f-d925-4ce5-81c8-96826e852a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6159545d61e04f748400399ec8db0526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:37Z,use_quota=True,user_id='24873c719da54142b33e1afb582b152f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07219723-3810-46fb-83cc-52628fd86f73),volume_type_id=07219723-3810-46fb-83cc-52628fd86f73)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Creating volume 17791c1f-d925-4ce5-81c8-96826e852a23 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:49 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:49 devstack sudo[105078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 1073741824
Nov 05 04:01:49 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adc667b-118d-4ce1-ae37-03cd6774455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559de328-9bbc-4743-b87f-ad5a6648f26b', 'volume_size': 1, 'snapshot_id': 'ea9a4edf-701f-40ca-86d3-9c9e82738ba7'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9369684e-6829-4bc5-a035-4150504a14d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Volume volume-559de328-9bbc-4743-b87f-ad5a6648f26b (559de328-9bbc-4743-b87f-ad5a6648f26b): created successfully
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9369684e-6829-4bc5-a035-4150504a14d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Flow 'volume_create_manager' (44ee432a-f5d9-49be-91b3-855616e26877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bf00c60a-9fac-4337-9aba-97327e0685c0 tempest-VolumeDependencyTests-1916663251 None] Created volume successfully.
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-ea9a4edf-701f-40ca-86d3-9c9e82738ba7-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-ea9a4edf-701f-40ca-86d3-9c9e82738ba7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-quobyte-4f23e81c-2669-4707-a51b-56903bc51e1f" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-4f23e81c-2669-4707-a51b-56903bc51e1f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-quobyte-ea9a4edf-701f-40ca-86d3-9c9e82738ba7" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-ea9a4edf-701f-40ca-86d3-9c9e82738ba7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Deleting offline snapshot ea9a4edf-701f-40ca-86d3-9c9e82738ba7 of volume 4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] snapshot_file for this snap is: volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3113a425-ce50-4b55-8f39-528449f07361]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:50 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 1073741824" returned: 0 in 0.523s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:50 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23
Nov 05 04:01:50 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:50 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7
Nov 05 04:01:50 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:50 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.229s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753835718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c035895-4299-4d7d-b5d2-a6df2c9c8349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:41Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Creating volume 3c035895-4299-4d7d-b5d2-a6df2c9c8349 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:50 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:50 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f23e81c-2669-4707-a51b-56903bc51e1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:01:50 devstack sudo[105092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349 1073741824
Nov 05 04:01:50 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b761e08e-57bf-4e6e-9274-5ca243e77b41]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Attempting download of fa27788c-b0ff-4842-9dcf-90a65fc07ecc ((None, [{'url': 'file:///opt/stack/data/glance/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'metadata': {}}])) to volume 17791c1f-d925-4ce5-81c8-96826e852a23. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c145cc92-fc9a-4be1-8b53-5984ed609e02]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_mw9ren5v {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:50 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f
Nov 05 04:01:50 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:50 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_mw9ren5v
Nov 05 04:01:50 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:51 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_mw9ren5v" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_mw9ren5v {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:51 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349 1073741824" returned: 0 in 0.606s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:51 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349
Nov 05 04:01:51 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:51 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f" returned: 0 in 0.667s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:51 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_mw9ren5v
Nov 05 04:01:51 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:51 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7
Nov 05 04:01:51 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:51 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349" returned: 0 in 0.295s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.551s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376340546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90299c0-0829-4718-afc8-3e36562add5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:42Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Creating volume b90299c0-0829-4718-afc8-3e36562add5b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:51 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:51 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b 1073741824
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84051ccb-ad51-41d3-a38f-f02be9cd324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:51 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a705226-84c9-4482-8cfe-634ba6c34a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349 (3c035895-4299-4d7d-b5d2-a6df2c9c8349): created successfully
Nov 05 04:01:51 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a705226-84c9-4482-8cfe-634ba6c34a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (57c09846-25bd-48f4-af0d-485d12f9757f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_mw9ren5v" returned: 1 in 0.487s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_mw9ren5v' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ff76b9-9448-4044-bfef-e62527901dfd]: (4, 'raw') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9b50ccfc-77d7-4fcb-b93e-66be1412b037 tempest-CreateVolumesFromSnapshotTest-32659150 None] Created volume successfully.
Nov 05 04:01:51 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:51 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD
Nov 05 04:01:51 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7" returned: 0 in 0.529s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:51 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7
Nov 05 04:01:51 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:51 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b 1073741824" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:51 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:52 devstack sudo[105135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b
Nov 05 04:01:52 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:52 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f.ea9a4edf-701f-40ca-86d3-9c9e82738ba7" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:52 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-ea9a4edf-701f-40ca-86d3-9c9e82738ba7" released by "_delete_snapshot" :: held 2.152s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:52 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-4f23e81c-2669-4707-a51b-56903bc51e1f" released by "delete_snapshot" :: held 2.192s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Created reservations ['d7eaceec-ea69-41bb-a039-669980a8c454', '84c7aa01-c8e0-4ad7-9140-0eaa1ea608af', '7a2d865b-b210-4d4c-9191-31a63c1f8cf3', 'c8ba29b1-e7f1-4c75-85d9-b815f3981eb9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:52 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.233s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088881592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280d3bce-4bcc-419b-9f0c-ba47cb7c1772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:42Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Creating volume 280d3bce-4bcc-419b-9f0c-ba47cb7c1772 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:52 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Delete snapshot completed successfully.
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:52 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772 1073741824
Nov 05 04:01:52 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Flow 'volume_create_manager' (2d6891de-3f48-45a9-883e-62871000b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:52 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfe623e-e5dc-4683-a354-733effc02dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083455be-aecc-446b-bf00-316c12ee91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90299c0-0829-4718-afc8-3e36562add5b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f664db2-e48b-4171-a97c-3527e8aeb94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-936c4cdc-b224-4610-a532-4acd2a00b39e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-ea9a4edf-701f-40ca-86d3-9c9e82738ba7-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] fa27788c-b0ff-4842-9dcf-90a65fc07ecc was raw, converting to qcow2 {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfe623e-e5dc-4683-a354-733effc02dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9614703a-1b81-443f-8057-2ad971192f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf104292db04cee90f87062ca85060b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:52Z,use_quota=True,user_id='d847d0f19cd144df87bf786678752806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23
Nov 05 04:01:52 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d43102-3836-420e-8f1c-b4d565aa4ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d43102-3836-420e-8f1c-b4d565aa4ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f70ec1-deae-437d-9e4b-965fd27e49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f70ec1-deae-437d-9e4b-965fd27e49cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9614703a-1b81-443f-8057-2ad971192f70', 'volume_name': 'volume-9614703a-1b81-443f-8057-2ad971192f70', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76983c04-fef5-40e7-8057-b7fdb78af818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76983c04-fef5-40e7-8057-b7fdb78af818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856810d6-0535-4362-a769-fd18da65e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Volume 9614703a-1b81-443f-8057-2ad971192f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9614703a-1b81-443f-8057-2ad971192f70', 'volume_size': 1}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume volume-b90299c0-0829-4718-afc8-3e36562add5b (b90299c0-0829-4718-afc8-3e36562add5b): created successfully
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f664db2-e48b-4171-a97c-3527e8aeb94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (f368466c-311e-4135-9850-a6b0ad0a0bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-51d0a825-224d-4919-abed-d1224ddc537f tempest-CreateVolumesFromSnapshotTest-32659150 None] Created volume successfully.
Nov 05 04:01:52 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772 1073741824" returned: 0 in 0.494s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:52 devstack sudo[105154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772
Nov 05 04:01:52 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:52 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23" returned: 0 in 0.511s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa27788c-b0ff-4842-9dcf-90a65fc07ecc_h2othidgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:01:52 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:53 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 1G
Nov 05 04:01:53 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-4f23e81c-2669-4707-a51b-56903bc51e1f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:53 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.604s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020104812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc9216-88e1-4feb-a475-455c6b9e6d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:42Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Creating volume 58dc9216-88e1-4feb-a475-455c6b9e6d06 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:53 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deaa01d-9ad2-4cd9-a2ea-c205f3925db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:53 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06 1073741824
Nov 05 04:01:53 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61521d86-19e9-4738-8cd3-669caaf5cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-4f23e81c-2669-4707-a51b-56903bc51e1f-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772 (280d3bce-4bcc-419b-9f0c-ba47cb7c1772): created successfully
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61521d86-19e9-4738-8cd3-669caaf5cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (e8bc8a37-db24-47b4-9179-b5f4768953ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6b85af16-1c26-4cc8-9130-a156457612ca tempest-CreateVolumesFromSnapshotTest-32659150 None] Created volume successfully.
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-quobyte-4f23e81c-2669-4707-a51b-56903bc51e1f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-4f23e81c-2669-4707-a51b-56903bc51e1f" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:53 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 1G" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Downloaded image fa27788c-b0ff-4842-9dcf-90a65fc07ecc ((None, [{'url': 'file:///opt/stack/data/glance/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'metadata': {}}])) to volume 17791c1f-d925-4ce5-81c8-96826e852a23 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Temporary image fa27788c-b0ff-4842-9dcf-90a65fc07ecc for user 24873c719da54142b33e1afb582b152f is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Marking volume 17791c1f-d925-4ce5-81c8-96826e852a23 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Copying metadata from image fa27788c-b0ff-4842-9dcf-90a65fc07ecc to 17791c1f-d925-4ce5-81c8-96826e852a23. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Creating volume glance metadata for volume 17791c1f-d925-4ce5-81c8-96826e852a23 backed by image fa27788c-b0ff-4842-9dcf-90a65fc07ecc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '69de1dc6d91f4bc4e2ea9fb576f99abf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9481e84-406f-4a41-b933-347485bd0fca]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31e33c6-bd86-430d-a579-9be059b9510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17791c1f-d925-4ce5-81c8-96826e852a23', 'volume_size': 1, 'image_id': 'fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69de1dc6d91f4bc4e2ea9fb576f99abf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6159545d61e04f748400399ec8db0526', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc13c6a6bab59ab0184533f9c928518911a8c60271ec655e2d0630998fa161e73b48ab5afa023d9188a6b04b11775a84edf430ae45a385c8aaf7d2705891e23d', 'id': 'fa27788c-b0ff-4842-9dcf-90a65fc07ecc', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa27788c-b0ff-4842-9dcf-90a65fc07ecc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9aaaff53a0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c521f0-649a-41d0-886a-80a9fcd4e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:53 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f
Nov 05 04:01:53 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Volume volume-17791c1f-d925-4ce5-81c8-96826e852a23 (17791c1f-d925-4ce5-81c8-96826e852a23): created successfully
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c521f0-649a-41d0-886a-80a9fcd4e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Flow 'volume_create_manager' (9fb86f7b-2761-4bac-bf3f-14fc993bc88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3b43ff7d-66ba-47d0-bc81-3e1bc3c1918a tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Created volume successfully.
Nov 05 04:01:53 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06 1073741824" returned: 0 in 0.516s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Acquiring lock "cinder-17791c1f-d925-4ce5-81c8-96826e852a23-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:53 devstack sudo[105173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06
Nov 05 04:01:53 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "cinder-17791c1f-d925-4ce5-81c8-96826e852a23-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Acquiring lock "cinder-quobyte-17791c1f-d925-4ce5-81c8-96826e852a23" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "cinder-quobyte-17791c1f-d925-4ce5-81c8-96826e852a23" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:53 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f" returned: 0 in 0.489s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[23959913-e05f-4589-95f7-e8556c0d6076]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:53 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f
Nov 05 04:01:53 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:54 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06" returned: 0 in 0.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.719s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518091602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f0ab6b-e8e5-4047-be10-9af4f7626659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56937e72a4d40c09c5802d02fa70e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:43Z,use_quota=True,user_id='19a1d051e3a84d579ef0524ae23ef619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Creating volume 55f0ab6b-e8e5-4047-be10-9af4f7626659 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:54 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23
Nov 05 04:01:54 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:54 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da1bb10-4849-4cbb-a8b2-01f9aa5b77be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58dc9216-88e1-4feb-a475-455c6b9e6d06', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:54 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659 1073741824
Nov 05 04:01:54 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf993a6-186c-454c-a418-0e64b215c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume volume-58dc9216-88e1-4feb-a475-455c6b9e6d06 (58dc9216-88e1-4feb-a475-455c6b9e6d06): created successfully
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf993a6-186c-454c-a418-0e64b215c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (bbc8f101-8559-462b-a8c5-c3288e143b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9cbb2cf3-1f6a-47e9-b4e5-6c82201f3c38 tempest-CreateVolumesFromSnapshotTest-32659150 None] Created volume successfully.
Nov 05 04:01:54 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4f23e81c-2669-4707-a51b-56903bc51e1f" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-4f23e81c-2669-4707-a51b-56903bc51e1f" released by "delete_volume" :: held 0.868s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Created reservations ['c0c68190-e75d-4d29-b576-2331cfa8156e', '2d285931-14bd-448a-8173-14e03393da51', '7941d924-dddb-40df-aeb6-1f82814d0610', '6cd938f5-ebfe-4f9f-86a4-f0f3ced58b15'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:54 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23" returned: 0 in 0.489s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:54 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:54 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:54 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23
Nov 05 04:01:54 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:54 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659 1073741824" returned: 0 in 0.525s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:54 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.277s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:54 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659
Nov 05 04:01:54 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Deleted volume successfully.
Nov 05 04:01:54 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8d44044b-bfc1-4a1d-afb2-38b0b4107efa tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-4f23e81c-2669-4707-a51b-56903bc51e1f-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-17791c1f-d925-4ce5-81c8-96826e852a23" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "cinder-quobyte-17791c1f-d925-4ce5-81c8-96826e852a23" released by "delete_volume" :: held 0.841s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Created reservations ['a930652a-a22c-4860-8ee4-7f1241a3c8ec', '9c29ed19-0183-4774-ab3b-7f8fbca8deaf', 'ba42b834-b5d1-45ef-95bc-9d2cea846654', 'fc806caa-512f-4a77-890b-8e989bb14262'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:54 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:54 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:54 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.416s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9614703a-1b81-443f-8057-2ad971192f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf104292db04cee90f87062ca85060b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:52Z,use_quota=True,user_id='d847d0f19cd144df87bf786678752806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Creating volume 9614703a-1b81-443f-8057-2ad971192f70 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:55 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70 1073741824
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:55 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88e48c4-1147-4b93-8da9-20e1b5b99409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f0ab6b-e8e5-4047-be10-9af4f7626659', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee518bd-ad7b-48cc-b5d9-6bcab87f2375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Volume volume-55f0ab6b-e8e5-4047-be10-9af4f7626659 (55f0ab6b-e8e5-4047-be10-9af4f7626659): created successfully
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee518bd-ad7b-48cc-b5d9-6bcab87f2375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Flow 'volume_create_manager' (faea20cf-a9f7-4a5e-8fc9-a00b19a635db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-78d94e0c-2451-41d9-856f-2a405b0814de tempest-CreateVolumesFromSnapshotTest-32659150 None] Created volume successfully.
Nov 05 04:01:55 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:55 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Deleted volume successfully.
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-23ab20b1-e702-474e-a702-a533e44219a5 tempest-VolumeAndVolumeTypeFromImageTest-1862613156 None] Lock "cinder-17791c1f-d925-4ce5-81c8-96826e852a23-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-55f0ab6b-e8e5-4047-be10-9af4f7626659-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-55f0ab6b-e8e5-4047-be10-9af4f7626659-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-559de328-9bbc-4743-b87f-ad5a6648f26b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-55f0ab6b-e8e5-4047-be10-9af4f7626659" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-559de328-9bbc-4743-b87f-ad5a6648f26b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-55f0ab6b-e8e5-4047-be10-9af4f7626659" acquired by "delete_volume" :: waited 0.053s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d03d29-d2c4-417c-8765-97acb20dbdbd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:55 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70 1073741824" returned: 0 in 0.743s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "cinder-quobyte-559de328-9bbc-4743-b87f-ad5a6648f26b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-559de328-9bbc-4743-b87f-ad5a6648f26b" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad95091-b3e4-4e1e-9ecb-6c838afc754a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:55 devstack sudo[105209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659
Nov 05 04:01:55 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:55 devstack sudo[105210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70
Nov 05 04:01:55 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:55 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b
Nov 05 04:01:55 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:56 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:56 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856810d6-0535-4362-a769-fd18da65e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9614703a-1b81-443f-8057-2ad971192f70', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0c9693-f031-4cc2-8b60-5f0938006592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659" returned: 0 in 0.535s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:56 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b" returned: 0 in 0.431s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:56 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659
Nov 05 04:01:56 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:56 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Volume volume-9614703a-1b81-443f-8057-2ad971192f70 (9614703a-1b81-443f-8057-2ad971192f70): created successfully
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0c9693-f031-4cc2-8b60-5f0938006592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Flow 'volume_create_manager' (2d6891de-3f48-45a9-883e-62871000b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:56 devstack sudo[105225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b
Nov 05 04:01:56 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-64de4c7e-d512-4376-b32a-4f8ad2df8c7a tempest-CinderUnicodeTest-127231584 None] Created volume successfully.
Nov 05 04:01:56 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-55f0ab6b-e8e5-4047-be10-9af4f7626659" returned: 0 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-55f0ab6b-e8e5-4047-be10-9af4f7626659" released by "delete_volume" :: held 0.935s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:56 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-559de328-9bbc-4743-b87f-ad5a6648f26b" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-quobyte-559de328-9bbc-4743-b87f-ad5a6648f26b" released by "delete_volume" :: held 0.861s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Created reservations ['4d86ec2d-d17d-469f-a252-4341cdde3244', 'aba9072b-da1f-477a-b507-d0456e9a1a72', '9de166f0-45d0-40fc-9f8b-9594dffb366f', 'f1ed560e-666e-4fd5-a49b-478b7eccd465'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Created reservations ['8d1289ae-3322-4167-b83e-6be9ca19673e', '1f5c1787-7dfd-42ff-ab22-f9a552575ee5', '40fcd216-438a-40e2-a6f0-94b16acfe465', '2e6b56b2-d3ad-4a69-bfcb-a07d12cb4fb0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:56 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:56 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:56 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:56 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:57 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Deleted volume successfully.
Nov 05 04:01:57 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Deleted volume successfully.
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eec185fa-5dfc-4c4c-a2b6-dabcfde4c848 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-55f0ab6b-e8e5-4047-be10-9af4f7626659-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4fb35fa4-b34b-4c13-b423-445d29e8da7e tempest-VolumeDependencyTests-1916663251 None] Lock "cinder-559de328-9bbc-4743-b87f-ad5a6648f26b-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Flow 'volume_create_manager' (c288b858-0468-43a9-9b14-32b993514596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5504c9a2-6a9f-4419-af93-054345452d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5504c9a2-6a9f-4419-af93-054345452d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1342624359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bddcc1-ff73-4d58-a5e7-efa80bf825eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf104292db04cee90f87062ca85060b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:57Z,use_quota=True,user_id='d847d0f19cd144df87bf786678752806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989befcf-8f1e-450e-8729-d44f6542477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989befcf-8f1e-450e-8729-d44f6542477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809f3821-9a42-4e9b-88fd-3b02823f511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809f3821-9a42-4e9b-88fd-3b02823f511f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28bddcc1-ff73-4d58-a5e7-efa80bf825eb', 'volume_name': 'volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aa18b4-5771-49be-80a9-24d441a17333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aa18b4-5771-49be-80a9-24d441a17333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ffeeb4-b4a3-469e-a764-1e4402b203cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Volume 28bddcc1-ff73-4d58-a5e7-efa80bf825eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb', 'volume_size': 1}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1342624359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bddcc1-ff73-4d58-a5e7-efa80bf825eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf104292db04cee90f87062ca85060b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:57Z,use_quota=True,user_id='d847d0f19cd144df87bf786678752806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Creating volume 28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:57 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb 1073741824
Nov 05 04:01:57 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-58dc9216-88e1-4feb-a475-455c6b9e6d06-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-58dc9216-88e1-4feb-a475-455c6b9e6d06-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-58dc9216-88e1-4feb-a475-455c6b9e6d06" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-58dc9216-88e1-4feb-a475-455c6b9e6d06" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[184718b1-b18c-4f7f-a075-1bccf6286471]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:58 devstack sudo[105240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06
Nov 05 04:01:58 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:58 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb 1073741824" returned: 0 in 0.607s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:58 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb
Nov 05 04:01:58 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:58 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06" returned: 0 in 0.504s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:58 devstack sudo[105250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06
Nov 05 04:01:58 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:58 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ffeeb4-b4a3-469e-a764-1e4402b203cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c02e83b-a0a9-4874-bcf9-b6aa741a0cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Volume volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb (28bddcc1-ff73-4d58-a5e7-efa80bf825eb): created successfully
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c02e83b-a0a9-4874-bcf9-b6aa741a0cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Flow 'volume_create_manager' (c288b858-0468-43a9-9b14-32b993514596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-30159573-170c-40d6-bca8-c57274dfd176 tempest-CinderUnicodeTest-127231584 None] Created volume successfully.
Nov 05 04:01:58 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-58dc9216-88e1-4feb-a475-455c6b9e6d06" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-58dc9216-88e1-4feb-a475-455c6b9e6d06" released by "delete_volume" :: held 0.945s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Created reservations ['f6bdc237-c1dd-435d-8721-20bfbe358930', 'a43751df-c2f2-456b-902a-59fca2a71944', '5bcf7083-18a3-4530-a761-755257c8f900', '9c889f60-3df9-4d8b-9b92-76f40d38902d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:59 devstack sudo[105254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:01:59 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:59 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:59 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Deleted volume successfully.
Nov 05 04:01:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d0d9e13-6bc8-4038-b966-178745e65b05 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-58dc9216-88e1-4feb-a475-455c6b9e6d06-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Creating offline snapshot 15078388-b391-42fb-bca8-a9f47258d8e0 of volume 28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bcaa74-439c-4b0b-b283-dd41d88b4cca]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-280d3bce-4bcc-419b-9f0c-ba47cb7c1772-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-280d3bce-4bcc-419b-9f0c-ba47cb7c1772-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-280d3bce-4bcc-419b-9f0c-ba47cb7c1772" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:00 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb
Nov 05 04:02:00 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-280d3bce-4bcc-419b-9f0c-ba47cb7c1772" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dfe346-8269-4447-a0bf-6a446b198a57]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:00 devstack sudo[105260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772
Nov 05 04:02:00 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:00 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" returned: 0 in 0.465s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:00 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 1G
Nov 05 04:02:00 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:00 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772" returned: 0 in 0.558s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:00 devstack sudo[105273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772
Nov 05 04:02:00 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (ed0cf080-bba5-4e3d-9f0d-44a4e0fab879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:01 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997e5860-baf3-4a6d-a795-801c5cb63aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 1G" returned: 0 in 0.659s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997e5860-baf3-4a6d-a795-801c5cb63aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610942390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449faff5-358f-4b47-a349-3805a76bfbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:01Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffbdfcd-3f05-4186-9a10-bebeab537bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffbdfcd-3f05-4186-9a10-bebeab537bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0
Nov 05 04:02:01 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c98356-05ef-461b-b6b0-a4d8aa62d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c98356-05ef-461b-b6b0-a4d8aa62d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449faff5-358f-4b47-a349-3805a76bfbed', 'volume_name': 'volume-449faff5-358f-4b47-a349-3805a76bfbed', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a27acda-720a-45c6-bd78-f01bdc8f7907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a27acda-720a-45c6-bd78-f01bdc8f7907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b20de5-b555-4149-a085-71ba9271b429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Volume 449faff5-358f-4b47-a349-3805a76bfbed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449faff5-358f-4b47-a349-3805a76bfbed', 'volume_size': 1}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-280d3bce-4bcc-419b-9f0c-ba47cb7c1772" returned: 0 in 0.444s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-280d3bce-4bcc-419b-9f0c-ba47cb7c1772" released by "delete_volume" :: held 1.061s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Created reservations ['e745f85c-1d5b-41f9-b0ef-759b77ecab0f', '1102c08f-c71e-4167-b284-f256034cd15f', '5470fca5-d0cb-4e98-90f5-cc8570ae0d1e', 'a3457e33-98a4-43d8-9d6c-92b480036487'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:01 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:01 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:01 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0" returned: 0 in 0.532s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:01 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 is being set with open permissions: ugo+rw
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:01 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0
Nov 05 04:02:01 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:01 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (cbbf1393-5eed-48af-ac7b-817e3ed615f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a237787-2916-409f-ba80-0075b5376505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a237787-2916-409f-ba80-0075b5376505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732513616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfebfc48-716b-48a4-a7c0-1ae30636e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:02Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40be4d8-b9a6-400e-87d7-be62c64dd162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40be4d8-b9a6-400e-87d7-be62c64dd162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7261b83c-e568-4187-af04-f53a1c3867bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7261b83c-e568-4187-af04-f53a1c3867bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfebfc48-716b-48a4-a7c0-1ae30636e0c0', 'volume_name': 'volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b85694d-a082-4e3e-a76f-5e122a625c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b85694d-a082-4e3e-a76f-5e122a625c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16406273-62c7-46c1-b242-06259e5dcca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Volume bfebfc48-716b-48a4-a7c0-1ae30636e0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0', 'volume_size': 1}
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Deleted volume successfully.
Nov 05 04:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03079cd2-e17f-40b4-95e4-71a2c1c5738c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-280d3bce-4bcc-419b-9f0c-ba47cb7c1772-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:02 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:02 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.info
Nov 05 04:02:02 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (fc5b55b4-c185-46f3-8996-df94bfd78aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeae9961-a43f-4b09-b60d-ec9a685a51bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeae9961-a43f-4b09-b60d-ec9a685a51bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27355793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ce053-5422-4779-9692-fda38da8c222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:02Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1f55aa-9218-4015-86a7-8c3028f167d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1f55aa-9218-4015-86a7-8c3028f167d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6083f633-9fbc-490c-8f4e-1028649f3bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6083f633-9fbc-490c-8f4e-1028649f3bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271ce053-5422-4779-9692-fda38da8c222', 'volume_name': 'volume-271ce053-5422-4779-9692-fda38da8c222', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40c052f-7279-489c-b9a5-b2201ce1795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40c052f-7279-489c-b9a5-b2201ce1795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f55861-ca9e-4d7b-bb58-a97ce46024e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Volume 271ce053-5422-4779-9692-fda38da8c222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271ce053-5422-4779-9692-fda38da8c222', 'volume_size': 1}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-b90299c0-0829-4718-afc8-3e36562add5b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-b90299c0-0829-4718-afc8-3e36562add5b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:02 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.info" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:02 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.info is being set with open permissions: ugo+rw
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-b90299c0-0829-4718-afc8-3e36562add5b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:02 devstack sudo[105292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.info
Nov 05 04:02:02 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-b90299c0-0829-4718-afc8-3e36562add5b" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9053b32b-f3d4-4bd7-9eb1-6cb557480e3f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (618a4f23-7c0b-46e9-a29d-d1f64c06e80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b27e877-ed79-4cf5-9fdf-16919a34a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b27e877-ed79-4cf5-9fdf-16919a34a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462579781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:03Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e44a64e-2251-43d3-9781-37ed0e71c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e44a64e-2251-43d3-9781-37ed0e71c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a37ec73-4e5c-449b-b728-547720e69cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a37ec73-4e5c-449b-b728-547720e69cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb', 'volume_name': 'volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b
Nov 05 04:02:02 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a4f770-a29f-4c0b-9f17-73f0fa1d30ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a4f770-a29f-4c0b-9f17-73f0fa1d30ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1abcad-eb2b-4cb2-b5bc-644a85baaff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Volume 9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb', 'volume_size': 1}
Nov 05 04:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:03 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.info" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.079s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.834s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610942390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449faff5-358f-4b47-a349-3805a76bfbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:01Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Creating volume 449faff5-358f-4b47-a349-3805a76bfbed {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:03 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:03 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed 1073741824
Nov 05 04:02:03 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-62b6f74c-d363-4955-9b92-d4432d0ee8a6 tempest-CinderUnicodeTest-127231584 None] Create snapshot completed successfully
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:03 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (eee9d32b-b72b-4046-830b-e3dcea9959dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a06c693-567b-4ec0-bfeb-170f37b831da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b" returned: 0 in 0.638s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a06c693-567b-4ec0-bfeb-170f37b831da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1581932980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a5174c-8dc4-4749-8634-4e71eeefd511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:03Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:03 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b
Nov 05 04:02:03 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41005dc3-f7f6-4f09-82f5-edfbeb572b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41005dc3-f7f6-4f09-82f5-edfbeb572b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a97414-ac83-411e-80a1-d1e42912671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a97414-ac83-411e-80a1-d1e42912671f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a5174c-8dc4-4749-8634-4e71eeefd511', 'volume_name': 'volume-39a5174c-8dc4-4749-8634-4e71eeefd511', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc6294e-d5f4-46a6-a5d0-433eb2309cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc6294e-d5f4-46a6-a5d0-433eb2309cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14275d5-3d5c-4511-a3dc-c2407f36a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Volume 39a5174c-8dc4-4749-8634-4e71eeefd511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a5174c-8dc4-4749-8634-4e71eeefd511', 'volume_size': 1}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:03 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-b90299c0-0829-4718-afc8-3e36562add5b" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-b90299c0-0829-4718-afc8-3e36562add5b" released by "delete_volume" :: held 1.004s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:03 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed 1073741824" returned: 0 in 0.618s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Created reservations ['104c287e-543b-42a7-bf93-45dfc739cb22', 'cd5810dc-7899-4174-ad0b-3d799fb36e58', 'e459f4b8-2aa9-41bf-b225-99f8974bf117', '6602f709-658d-4e4e-a0e8-fb307546407f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:03 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed
Nov 05 04:02:03 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:03 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:03 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:04 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732513616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfebfc48-716b-48a4-a7c0-1ae30636e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:02Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Creating volume bfebfc48-716b-48a4-a7c0-1ae30636e0c0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b20de5-b555-4149-a085-71ba9271b429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449faff5-358f-4b47-a349-3805a76bfbed', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:04 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0 1073741824
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e296a374-c8fd-4f84-a438-60334d4ba39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:04 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Volume volume-449faff5-358f-4b47-a349-3805a76bfbed (449faff5-358f-4b47-a349-3805a76bfbed): created successfully
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e296a374-c8fd-4f84-a438-60334d4ba39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (ed0cf080-bba5-4e3d-9f0d-44a4e0fab879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:04 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Deleted volume successfully.
Nov 05 04:02:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-63a97210-8f05-474f-8e66-23a40ca6db1b tempest-CreateVolumesFromImageTest-1107266319 None] Created volume successfully.
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22d189f5-c08a-4709-aa8e-f2e51a853fc9 tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-b90299c0-0829-4718-afc8-3e36562add5b-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Acquiring lock "cinder-15078388-b391-42fb-bca8-a9f47258d8e0-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Lock "cinder-15078388-b391-42fb-bca8-a9f47258d8e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Acquiring lock "cinder-quobyte-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Acquiring lock "cinder-quobyte-15078388-b391-42fb-bca8-a9f47258d8e0" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-15078388-b391-42fb-bca8-a9f47258d8e0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Deleting offline snapshot 15078388-b391-42fb-bca8-a9f47258d8e0 of volume 28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] snapshot_file for this snap is: volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[841df11d-47e8-47cc-9310-71831023dec9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:04 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0
Nov 05 04:02:04 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:04 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0 1073741824" returned: 0 in 0.587s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:04 devstack sudo[105324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0
Nov 05 04:02:04 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-3c035895-4299-4d7d-b5d2-a6df2c9c8349-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-3c035895-4299-4d7d-b5d2-a6df2c9c8349-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-3c035895-4299-4d7d-b5d2-a6df2c9c8349" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:04 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-3c035895-4299-4d7d-b5d2-a6df2c9c8349" acquired by "delete_volume" :: waited 0.046s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2babd465-fed8-42bf-8342-148acb594cea]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8025a55-089a-4716-89a1-cd24977b286d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:05 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.620s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27355793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ce053-5422-4779-9692-fda38da8c222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:02Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Creating volume 271ce053-5422-4779-9692-fda38da8c222 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16406273-62c7-46c1-b242-06259e5dcca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30e1f47-f2c7-4829-9fcf-7c909bd3812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:05 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222 1073741824
Nov 05 04:02:05 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Volume volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0 (bfebfc48-716b-48a4-a7c0-1ae30636e0c0): created successfully
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30e1f47-f2c7-4829-9fcf-7c909bd3812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:05 devstack sudo[105331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349
Nov 05 04:02:05 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (cbbf1393-5eed-48af-ac7b-817e3ed615f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2227dd9c-5305-40aa-86b6-e659d8d3a274 tempest-CreateVolumesFromImageTest-1107266319 None] Created volume successfully.
Nov 05 04:02:05 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb
Nov 05 04:02:05 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:05 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349" returned: 0 in 0.544s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:05 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349
Nov 05 04:02:05 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:05 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" returned: 0 in 0.683s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:05 devstack sudo[105347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0
Nov 05 04:02:05 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:05 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222 1073741824" returned: 0 in 0.775s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:05 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-3c035895-4299-4d7d-b5d2-a6df2c9c8349" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-3c035895-4299-4d7d-b5d2-a6df2c9c8349" released by "delete_volume" :: held 0.960s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:05 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222
Nov 05 04:02:05 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Created reservations ['fbf8e8b6-c246-459b-8fd9-64175cd34b7b', '120a6e7b-c9a7-4185-8d78-4c00e1764657', 'e39ca775-efd8-48dd-8e34-41e5cce47c50', 'c8694854-6ea6-4373-8d05-cb3f2b0ddf6b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:06 devstack sudo[105358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:06 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:06 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0" returned: 0 in 0.501s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:06 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0
Nov 05 04:02:06 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:06 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222" returned: 0 in 0.357s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.356s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462579781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:03Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Creating volume 9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:06 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:06 devstack sudo[105363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb 1073741824
Nov 05 04:02:06 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f55861-ca9e-4d7b-bb58-a97ce46024e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271ce053-5422-4779-9692-fda38da8c222', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1af18f6-6ddc-41d4-9df1-f19ce457b3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Volume volume-271ce053-5422-4779-9692-fda38da8c222 (271ce053-5422-4779-9692-fda38da8c222): created successfully
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1af18f6-6ddc-41d4-9df1-f19ce457b3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:06 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (fc5b55b4-c185-46f3-8996-df94bfd78aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Deleted volume successfully.
Nov 05 04:02:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bb70c669-27d8-4750-bc9b-a545c54f541e tempest-CreateVolumesFromImageTest-1107266319 None] Created volume successfully.
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4e83641a-99ac-4c7c-8c55-23ccd5a1b71b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-3c035895-4299-4d7d-b5d2-a6df2c9c8349-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:06 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb.15078388-b391-42fb-bca8-a9f47258d8e0" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-15078388-b391-42fb-bca8-a9f47258d8e0" released by "_delete_snapshot" :: held 2.270s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" released by "delete_snapshot" :: held 2.298s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Created reservations ['ec04646c-545b-4068-ba30-a40a2e9c4cb5', '5f8db871-2c67-46cc-850f-9b585e0ece76', '12aac165-e4ef-4d88-a8e6-86f7b35dcbad', 'fb8f515e-736e-4c38-9c41-64a19bf002d6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Delete snapshot completed successfully.
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-280aeb37-9770-4a3c-8fbd-84566caed42a tempest-CinderUnicodeTest-127231584 None] Lock "cinder-15078388-b391-42fb-bca8-a9f47258d8e0-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:06 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb 1073741824" returned: 0 in 0.599s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:06 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb
Nov 05 04:02:06 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-902b3d44-7c99-41ee-8011-3700d4751e3a-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-902b3d44-7c99-41ee-8011-3700d4751e3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-80c21756-ff5c-4705-a84b-90be38e883a1" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-80c21756-ff5c-4705-a84b-90be38e883a1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-902b3d44-7c99-41ee-8011-3700d4751e3a" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-902b3d44-7c99-41ee-8011-3700d4751e3a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Deleting offline snapshot 902b3d44-7c99-41ee-8011-3700d4751e3a of volume 80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] snapshot_file for this snap is: volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa636aca-dcce-4340-90a1-4593326b5139]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:07 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.813s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1581932980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a5174c-8dc4-4749-8634-4e71eeefd511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456512f1121442f5a1ed451cc2ee40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:03Z,use_quota=True,user_id='992dabdce08345648ecb21dcb3da7b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Creating volume 39a5174c-8dc4-4749-8634-4e71eeefd511 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:07 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1abcad-eb2b-4cb2-b5bc-644a85baaff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:07 devstack sudo[105375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511 1073741824
Nov 05 04:02:07 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3571afa-b051-4916-a4ab-297a3977cd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Volume volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb (9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb): created successfully
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3571afa-b051-4916-a4ab-297a3977cd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (618a4f23-7c0b-46e9-a29d-d1f64c06e80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4010ebe8-8c0a-40ef-98e3-ec4b4d10c80a tempest-CreateVolumesFromImageTest-1107266319 None] Created volume successfully.
Nov 05 04:02:07 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a
Nov 05 04:02:07 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:07 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Acquiring lock "cinder-28bddcc1-ff73-4d58-a5e7-efa80bf825eb-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a" returned: 0 in 0.447s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80c21756-ff5c-4705-a84b-90be38e883a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Lock "cinder-28bddcc1-ff73-4d58-a5e7-efa80bf825eb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[868e641a-f243-48f3-b2b9-9c08779d6b25]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Acquiring lock "cinder-quobyte-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:07 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511 1073741824" returned: 0 in 0.593s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[267fbbbe-c395-45e4-8c1e-59a8c7aa3142]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:07 devstack sudo[105386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1
Nov 05 04:02:07 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:07 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511
Nov 05 04:02:07 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:07 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb
Nov 05 04:02:07 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:08 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14275d5-3d5c-4511-a3dc-c2407f36a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a5174c-8dc4-4749-8634-4e71eeefd511', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:08 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8e430a-e39d-475e-a085-14e862f23ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1" returned: 0 in 0.542s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Volume volume-39a5174c-8dc4-4749-8634-4e71eeefd511 (39a5174c-8dc4-4749-8634-4e71eeefd511): created successfully
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8e430a-e39d-475e-a085-14e862f23ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:08 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a
Nov 05 04:02:08 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Flow 'volume_create_manager' (eee9d32b-b72b-4046-830b-e3dcea9959dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fe084055-1bde-44d0-a495-90da459dacd0 tempest-CreateVolumesFromImageTest-1107266319 None] Created volume successfully.
Nov 05 04:02:08 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:08 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb
Nov 05 04:02:08 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:08 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:08 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-28bddcc1-ff73-4d58-a5e7-efa80bf825eb" released by "delete_volume" :: held 0.871s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:08 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a
Nov 05 04:02:08 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Created reservations ['e3257f4d-94c9-44f2-98f1-d0cbc3ef204d', '37e0a048-0edd-4607-9a81-ede87887855d', '87ddcb49-a4fc-451a-bbbb-674202bae5d9', '61baf60f-6c1c-415b-9dbf-70e74ed5963d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:08 devstack sudo[105409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:08 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:08 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1.902b3d44-7c99-41ee-8011-3700d4751e3a" returned: 0 in 0.293s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-902b3d44-7c99-41ee-8011-3700d4751e3a" released by "_delete_snapshot" :: held 1.845s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-80c21756-ff5c-4705-a84b-90be38e883a1" released by "delete_snapshot" :: held 1.870s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-39a5174c-8dc4-4749-8634-4e71eeefd511-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Created reservations ['5c87fd74-150c-4dbd-a742-ccdf8058659a', 'f9220686-b116-4533-adc7-cbc1a8f515d6', 'fdc560a9-feab-46d9-9f14-4cf719cd548f', 'f5412750-ea3e-4220-9bbb-40f1b07495d9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:09 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-39a5174c-8dc4-4749-8634-4e71eeefd511-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Deleted volume successfully.
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-90f32964-9333-4770-94ae-296e207d9065 tempest-CinderUnicodeTest-127231584 None] Lock "cinder-28bddcc1-ff73-4d58-a5e7-efa80bf825eb-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-quobyte-39a5174c-8dc4-4749-8634-4e71eeefd511" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Delete snapshot completed successfully.
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-39a5174c-8dc4-4749-8634-4e71eeefd511" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0a12e83-840f-412e-8911-f3e3ad29498c tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-902b3d44-7c99-41ee-8011-3700d4751e3a-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[56806963-2e3f-4db1-a7a8-77482552bf7a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:09 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511
Nov 05 04:02:09 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:09 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511" returned: 0 in 0.387s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:09 devstack sudo[105419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511
Nov 05 04:02:09 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Acquiring lock "cinder-9614703a-1b81-443f-8057-2ad971192f70-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:09 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-39a5174c-8dc4-4749-8634-4e71eeefd511" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-39a5174c-8dc4-4749-8634-4e71eeefd511" released by "delete_volume" :: held 0.701s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Lock "cinder-9614703a-1b81-443f-8057-2ad971192f70-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Acquiring lock "cinder-quobyte-9614703a-1b81-443f-8057-2ad971192f70" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-9614703a-1b81-443f-8057-2ad971192f70" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Created reservations ['07b1a463-25d9-4367-a2d8-1e1c2772ab30', '23666519-01ff-46f8-80ce-3a834fb924c4', 'f8458032-ed9d-49cb-b245-8a9aa2af13b7', 'fbaeb064-cedc-4e05-a86b-19653a9aff33'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c953fcc-c934-416b-bb97-41c62857b210]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:10 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:10 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:10 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70
Nov 05 04:02:10 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-80c21756-ff5c-4705-a84b-90be38e883a1-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-80c21756-ff5c-4705-a84b-90be38e883a1-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-quobyte-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:10 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "cinder-quobyte-80c21756-ff5c-4705-a84b-90be38e883a1" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Deleted volume successfully.
Nov 05 04:02:10 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c146ed5-e564-414a-a752-a06876439d99]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-80c21756-ff5c-4705-a84b-90be38e883a1" acquired by "delete_volume" :: waited 0.047s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:10 devstack sudo[105432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70
Nov 05 04:02:10 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[31136d59-4a42-4539-940e-8c494fbdb7d4]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:10 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb
Nov 05 04:02:10 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:10 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:10 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e9c7e48-3d3c-4433-83aa-259aef163992 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-39a5174c-8dc4-4749-8634-4e71eeefd511-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:10 devstack sudo[105435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1
Nov 05 04:02:10 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:10 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9614703a-1b81-443f-8057-2ad971192f70" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Lock "cinder-quobyte-9614703a-1b81-443f-8057-2ad971192f70" released by "delete_volume" :: held 0.919s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Created reservations ['5180808f-eb44-49f7-8e41-f3f5be8c1b25', 'fa7c583e-cd52-484c-aebc-2ec8cc01d4b2', 'ef202d4a-48ee-4ee3-a286-dc1c8a7ad9e0', 'f520ce87-3041-4266-b1ea-1e4216ebe594'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:11 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.500s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 04:02:11 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:11 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:11 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb" returned: 0 in 0.676s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:11 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb
Nov 05 04:02:11 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:11 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1" returned: 0 in 0.611s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:11 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1
Nov 05 04:02:11 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:11 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb" returned: 0 in 0.318s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb" released by "delete_volume" :: held 1.058s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:11 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Deleted volume successfully.
Nov 05 04:02:11 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-80c21756-ff5c-4705-a84b-90be38e883a1" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17bfe3ba-56d9-4e21-8ced-93cbb512cb9d tempest-CinderUnicodeTest-127231584 None] Lock "cinder-9614703a-1b81-443f-8057-2ad971192f70-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-quobyte-80c21756-ff5c-4705-a84b-90be38e883a1" released by "delete_volume" :: held 1.072s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Created reservations ['5ecd8552-ad7a-464e-bfeb-79589b2fcea8', 'dff810d2-ec39-48f6-af2c-a35ff51b7ffb', '30fba195-2c05-40f3-9389-78205708f367', 'e94a66af-04b7-4683-b0dc-7c0f05aa236d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Created reservations ['9520f591-0252-4886-9903-55b16bc164a0', 'daa60a77-7bf8-4391-9292-08d4c8fa3115', '67ee64cc-9401-49e2-998e-6eb4adc037ee', '1e2bddef-e631-4dcf-b89b-4e4a46af81a3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:11 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:11 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:11 devstack sudo[105458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:11 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:12 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Deleted volume successfully.
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10c3132a-f310-45f0-9e75-70e85b14f3ce tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-9ff2c830-778e-48d8-b1df-bd8dd7ebd9cb-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:12 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.272s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Deleted volume successfully.
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eed18fc0-9778-41a7-9835-2275c57df99b tempest-CreateVolumesFromSnapshotTest-32659150 None] Lock "cinder-80c21756-ff5c-4705-a84b-90be38e883a1-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-271ce053-5422-4779-9692-fda38da8c222-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-271ce053-5422-4779-9692-fda38da8c222-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-quobyte-271ce053-5422-4779-9692-fda38da8c222" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-271ce053-5422-4779-9692-fda38da8c222" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca615c85-b704-4264-8b42-758f82223d23]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:12 devstack sudo[105462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222
Nov 05 04:02:12 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:13 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222" returned: 0 in 0.442s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:13 devstack sudo[105467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222
Nov 05 04:02:13 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:13 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-271ce053-5422-4779-9692-fda38da8c222" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-271ce053-5422-4779-9692-fda38da8c222" released by "delete_volume" :: held 0.873s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Created reservations ['e03e13be-737d-47da-a2b2-b15a3bb135d3', '956248a7-194a-48ee-8b0d-97d54db383fa', '51ad914d-b845-4964-8354-fb3f30d06f09', 'd89ae4c4-a6a1-4927-b1b0-105d3cc5ac7a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:13 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:13 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-bfebfc48-716b-48a4-a7c0-1ae30636e0c0-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-bfebfc48-716b-48a4-a7c0-1ae30636e0c0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-quobyte-bfebfc48-716b-48a4-a7c0-1ae30636e0c0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-bfebfc48-716b-48a4-a7c0-1ae30636e0c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e6bc4-0437-434f-8481-4c1493d77be9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:14 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Deleted volume successfully.
Nov 05 04:02:14 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0
Nov 05 04:02:14 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-739a1197-bcf9-4a1e-8fb0-5f469e1a61f7 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-271ce053-5422-4779-9692-fda38da8c222-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:14 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0" returned: 0 in 0.526s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:14 devstack sudo[105479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0
Nov 05 04:02:14 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:14 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bfebfc48-716b-48a4-a7c0-1ae30636e0c0" returned: 0 in 0.256s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-bfebfc48-716b-48a4-a7c0-1ae30636e0c0" released by "delete_volume" :: held 0.860s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Created reservations ['35346009-bbfc-46dc-ad43-92f8e4230d1c', 'dec10b1c-2a98-4b31-a734-9a3ac600f1bd', '0095b99a-52f7-47c1-8319-10023ab10113', '25779be1-cfc5-4345-993f-b3c6b0343362'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:15 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:15 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-449faff5-358f-4b47-a349-3805a76bfbed-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-449faff5-358f-4b47-a349-3805a76bfbed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "cinder-quobyte-449faff5-358f-4b47-a349-3805a76bfbed" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-449faff5-358f-4b47-a349-3805a76bfbed" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a070a8f-f477-480e-9e22-8cc4afb67995]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:15 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:15 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed
Nov 05 04:02:15 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Deleted volume successfully.
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13e42249-206d-4156-bfa6-e2491b43a833 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-bfebfc48-716b-48a4-a7c0-1ae30636e0c0-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:15 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:15 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed
Nov 05 04:02:15 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:16 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-449faff5-358f-4b47-a349-3805a76bfbed" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-quobyte-449faff5-358f-4b47-a349-3805a76bfbed" released by "delete_volume" :: held 0.819s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Created reservations ['b93e2c36-579b-4eb0-a875-464ca2f068e0', 'dc6b646f-24aa-4ef5-8c02-dcf017e20fae', '49ac0dd4-467b-405e-b9c1-3e7fb3341caf', '85b4eff5-f268-4995-b678-52c9a6610ec0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:16 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:16 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:16 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Deleted volume successfully.
Nov 05 04:02:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe88b4fd-61f1-438a-b65d-918b6b518454 tempest-CreateVolumesFromImageTest-1107266319 None] Lock "cinder-449faff5-358f-4b47-a349-3805a76bfbed-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (2eac6d37-d4f3-4213-82f6-bfc91c877e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eaf7ec-f56a-4293-b396-d551ee46b565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eaf7ec-f56a-4293-b396-d551ee46b565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539501255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3da5e40-a88a-4bd3-b3a9-68eb0d72883f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a146f3d3-3a25-4620-a681-a977bfa64514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a146f3d3-3a25-4620-a681-a977bfa64514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7802c8-7fc9-4ef1-8e75-104c188511f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7802c8-7fc9-4ef1-8e75-104c188511f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3da5e40-a88a-4bd3-b3a9-68eb0d72883f', 'volume_name': 'volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9dfb3a-59e1-45f2-8dcb-f27d8f18143e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9dfb3a-59e1-45f2-8dcb-f27d8f18143e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1b394b-103e-4644-89fc-c6b8fc8a26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume e3da5e40-a88a-4bd3-b3a9-68eb0d72883f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f', 'volume_size': 1}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539501255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3da5e40-a88a-4bd3-b3a9-68eb0d72883f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Creating volume e3da5e40-a88a-4bd3-b3a9-68eb0d72883f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:17 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f 1073741824
Nov 05 04:02:17 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (be61e692-7747-4c5e-b563-ccba5507ecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85052e4a-34f7-46c7-9430-56e32be0d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85052e4a-34f7-46c7-9430-56e32be0d772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509167830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebe02b9-5b08-4c91-b69e-6e9138f623d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35e91dd-6a2c-4a5e-9dbb-e30b3c2ed8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35e91dd-6a2c-4a5e-9dbb-e30b3c2ed8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ef612f-deaa-465d-968e-4aa6fcf2c5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ef612f-deaa-465d-968e-4aa6fcf2c5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebe02b9-5b08-4c91-b69e-6e9138f623d7', 'volume_name': 'volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01f7054-484b-4fac-86c9-52220e48fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01f7054-484b-4fac-86c9-52220e48fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad605281-f4c6-4cd9-a053-32015f78b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Volume 7ebe02b9-5b08-4c91-b69e-6e9138f623d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7', 'volume_size': 1}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:18 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f 1073741824" returned: 0 in 0.705s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:18 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f
Nov 05 04:02:18 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:18 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f" returned: 0 in 0.323s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509167830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebe02b9-5b08-4c91-b69e-6e9138f623d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Creating volume 7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:18 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 1073741824
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1b394b-103e-4644-89fc-c6b8fc8a26dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:18 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd725be-5042-404f-a3a8-6228e186420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f (e3da5e40-a88a-4bd3-b3a9-68eb0d72883f): created successfully
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd725be-5042-404f-a3a8-6228e186420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (2eac6d37-d4f3-4213-82f6-bfc91c877e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-87d855e7-d8d3-4e4d-9611-596b9b89bfdd tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created volume successfully.
Nov 05 04:02:19 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 1073741824" returned: 0 in 0.587s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:19 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7
Nov 05 04:02:19 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:19 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad605281-f4c6-4cd9-a053-32015f78b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2d0588-f783-45bc-ab4c-163e6b148e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Volume volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 (7ebe02b9-5b08-4c91-b69e-6e9138f623d7): created successfully
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2d0588-f783-45bc-ab4c-163e6b148e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (be61e692-7747-4c5e-b563-ccba5507ecc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fbf6a2a6-dc69-4ae2-9e77-19d54cab60d2 tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (8bc52503-515f-44e5-8fe6-00497123865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea24746-b1ef-4ba7-b785-f8bf60ecb057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea24746-b1ef-4ba7-b785-f8bf60ecb057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517435265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de24b79-f396-4323-9392-62c1f1eefd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:20Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a586fd-d7fc-424a-b428-d127ce70d56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a586fd-d7fc-424a-b428-d127ce70d56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b186aff-73cb-433f-b7f9-067eb07f4d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b186aff-73cb-433f-b7f9-067eb07f4d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de24b79-f396-4323-9392-62c1f1eefd8e', 'volume_name': 'volume-0de24b79-f396-4323-9392-62c1f1eefd8e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f45c95d-be39-4dfb-9d5d-a7816ec16017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f45c95d-be39-4dfb-9d5d-a7816ec16017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d128e20-1337-4268-aff0-48b6f4f6755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume 0de24b79-f396-4323-9392-62c1f1eefd8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de24b79-f396-4323-9392-62c1f1eefd8e', 'volume_size': 1}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517435265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de24b79-f396-4323-9392-62c1f1eefd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:20Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Creating volume 0de24b79-f396-4323-9392-62c1f1eefd8e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:20 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:20 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e 1073741824
Nov 05 04:02:20 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (63c17179-d1ff-4f79-9883-d614fe614879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09845b38-f10d-4c42-af4a-c959b4a621b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e 1073741824" returned: 0 in 0.588s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09845b38-f10d-4c42-af4a-c959b4a621b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411515374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c7ff65-5ce9-4d05-bb8f-21e90f230426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:21Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c2b3b0-d325-492a-b75d-592dd2ea3583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c2b3b0-d325-492a-b75d-592dd2ea3583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd3619c-f61a-404a-bcd6-9444f66d5c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd3619c-f61a-404a-bcd6-9444f66d5c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c7ff65-5ce9-4d05-bb8f-21e90f230426', 'volume_name': 'volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161982c9-6a93-47d9-bf52-820614e6a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161982c9-6a93-47d9-bf52-820614e6a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5448a658-7e12-4261-bee3-613e5114b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume 65c7ff65-5ce9-4d05-bb8f-21e90f230426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426', 'volume_size': 1}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85485658-5d1b-48f7-ba40-9860708be8fe tempest-ProjectAdminTests-1566875356 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4853}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:21 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e
Nov 05 04:02:21 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (bb8f6b1c-adcb-49bd-8632-f75816d438ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028f285d-f982-497e-b7f9-7d218862af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028f285d-f982-497e-b7f9-7d218862af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64920650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f58ace3-1068-468e-895c-da3b799888c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:21Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc39b074-b405-4ad4-b986-d5aa6d01c486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc39b074-b405-4ad4-b986-d5aa6d01c486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd326c4-33da-41b1-aff1-ba3e41c3b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd326c4-33da-41b1-aff1-ba3e41c3b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f58ace3-1068-468e-895c-da3b799888c9', 'volume_name': 'volume-5f58ace3-1068-468e-895c-da3b799888c9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5e4ae0-3a79-4bd1-89f7-742241c2f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5e4ae0-3a79-4bd1-89f7-742241c2f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa91f26-f62b-447d-b305-e66359e18a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume 5f58ace3-1068-468e-895c-da3b799888c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f58ace3-1068-468e-895c-da3b799888c9', 'volume_size': 1}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:21 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411515374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c7ff65-5ce9-4d05-bb8f-21e90f230426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:21Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Creating volume 65c7ff65-5ce9-4d05-bb8f-21e90f230426 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:21 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426 1073741824
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d128e20-1337-4268-aff0-48b6f4f6755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de24b79-f396-4323-9392-62c1f1eefd8e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63605c37-79b2-47d8-b1b6-b9106b1611ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume volume-0de24b79-f396-4323-9392-62c1f1eefd8e (0de24b79-f396-4323-9392-62c1f1eefd8e): created successfully
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63605c37-79b2-47d8-b1b6-b9106b1611ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (8bc52503-515f-44e5-8fe6-00497123865a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-45151d41-e902-4a70-892a-35434343c773 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created volume successfully.
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (b395a465-c8cd-422d-af7a-dc76c5499342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53b87e5-0856-437c-8ddc-7578419955a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53b87e5-0856-437c-8ddc-7578419955a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763930546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32ddf78-10cc-4628-a611-3c7a8c75f3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413ff10b-4373-4310-8369-55319babca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413ff10b-4373-4310-8369-55319babca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f6056c-f56a-4a50-ae57-3836c9428fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f6056c-f56a-4a50-ae57-3836c9428fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32ddf78-10cc-4628-a611-3c7a8c75f3d5', 'volume_name': 'volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e89a374-cbaf-45cc-b3df-7fac5d687873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e89a374-cbaf-45cc-b3df-7fac5d687873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e81733-d9ee-40b3-adb6-10ffd11bacf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume c32ddf78-10cc-4628-a611-3c7a8c75f3d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5', 'volume_size': 1}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:22 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426 1073741824" returned: 0 in 0.608s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:22 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426
Nov 05 04:02:22 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (8f783b79-dcaf-4fab-a42d-960990439a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00332e78-392c-4940-94e6-16b2ab2a347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00332e78-392c-4940-94e6-16b2ab2a347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e11878-9260-4d54-9473-17a0afa10e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212efd1e-9116-45fc-80e2-beb4c190f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212efd1e-9116-45fc-80e2-beb4c190f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef3ac6-26a8-4ac2-9ee4-b4c307f48ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef3ac6-26a8-4ac2-9ee4-b4c307f48ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e11878-9260-4d54-9473-17a0afa10e7f', 'volume_name': 'volume-a1e11878-9260-4d54-9473-17a0afa10e7f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea765e74-3f31-4dee-874b-aab9efbad546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea765e74-3f31-4dee-874b-aab9efbad546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a9b418-636f-4c70-a169-1c0860111980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume a1e11878-9260-4d54-9473-17a0afa10e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e11878-9260-4d54-9473-17a0afa10e7f', 'volume_size': 1}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:22 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426" returned: 0 in 0.265s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64920650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f58ace3-1068-468e-895c-da3b799888c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:21Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Creating volume 5f58ace3-1068-468e-895c-da3b799888c9 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:22 devstack sudo[105536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9 1073741824
Nov 05 04:02:22 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5448a658-7e12-4261-bee3-613e5114b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c96513-be6d-438a-99ec-6e82cd205ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426 (65c7ff65-5ce9-4d05-bb8f-21e90f230426): created successfully
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c96513-be6d-438a-99ec-6e82cd205ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (63c17179-d1ff-4f79-9883-d614fe614879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f05294b9-f205-49f1-9862-084f573c0b6e tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created volume successfully.
Nov 05 04:02:23 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9 1073741824" returned: 0 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:23 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9
Nov 05 04:02:23 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:23 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9" returned: 0 in 0.253s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.733s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa91f26-f62b-447d-b305-e66359e18a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f58ace3-1068-468e-895c-da3b799888c9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c92affd-7b0f-4b8c-8291-47545e254045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 4ff71960-78bf-457c-be44-ebfe1ff161cb of volume 7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume volume-5f58ace3-1068-468e-895c-da3b799888c9 (5f58ace3-1068-468e-895c-da3b799888c9): created successfully
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c92affd-7b0f-4b8c-8291-47545e254045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (bb8f6b1c-adcb-49bd-8632-f75816d438ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b0422-ae63-454d-8ec5-3c6cfb33609e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-936486c1-293b-477c-b855-553660346045 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created volume successfully.
Nov 05 04:02:23 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7
Nov 05 04:02:23 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:23 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" returned: 0 in 0.413s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:23 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb 1G
Nov 05 04:02:23 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:24 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb 1G" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:24 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb
Nov 05 04:02:24 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:24 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:24 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb is being set with open permissions: ugo+rw
Nov 05 04:02:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:24 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb
Nov 05 04:02:24 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:24 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:24 devstack sudo[105563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.info
Nov 05 04:02:24 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:25 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.info" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:25 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.info is being set with open permissions: ugo+rw
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:25 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.info
Nov 05 04:02:25 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:25 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.info" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.353s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763930546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32ddf78-10cc-4628-a611-3c7a8c75f3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Creating volume c32ddf78-10cc-4628-a611-3c7a8c75f3d5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:25 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:25 devstack sudo[105569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5 1073741824
Nov 05 04:02:25 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-17a16348-d063-4ac6-b663-53bf28dc0009 tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (929aa15d-bccc-4970-a6cf-c61f77fc624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bc6df3-c24e-42bb-90f8-9aee9fb3bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-4ff71960-78bf-457c-be44-ebfe1ff161cb-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bc6df3-c24e-42bb-90f8-9aee9fb3bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50642697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60c3425-c601-4b18-bf12-4b40ad9180c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:26Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d10b70d-44be-429c-8131-ec402d085a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d10b70d-44be-429c-8131-ec402d085a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15762f55-88a8-488b-8cde-b321ca4479d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15762f55-88a8-488b-8cde-b321ca4479d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e60c3425-c601-4b18-bf12-4b40ad9180c7', 'volume_name': 'volume-e60c3425-c601-4b18-bf12-4b40ad9180c7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9073ecf6-302f-44e2-92db-ced75c5ec9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9073ecf6-302f-44e2-92db-ced75c5ec9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75755d90-c61b-4676-8e4d-4b39fe6a26ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Volume e60c3425-c601-4b18-bf12-4b40ad9180c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e60c3425-c601-4b18-bf12-4b40ad9180c7', 'volume_size': 1}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-4ff71960-78bf-457c-be44-ebfe1ff161cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-4ff71960-78bf-457c-be44-ebfe1ff161cb" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-4ff71960-78bf-457c-be44-ebfe1ff161cb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 4ff71960-78bf-457c-be44-ebfe1ff161cb of volume 7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[837e6588-7b23-4ac0-a289-13677cdab20e]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5 1073741824" returned: 0 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb
Nov 05 04:02:26 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5
Nov 05 04:02:26 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:26 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.876s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e11878-9260-4d54-9473-17a0afa10e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf2f4414d2b4bed866e12ae0b1c8d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='ea89050833bf4b119567b80b1c353c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Creating volume a1e11878-9260-4d54-9473-17a0afa10e7f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:26 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[543fd28d-3e2c-409e-a57a-3b796f67e77f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f 1073741824
Nov 05 04:02:26 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e81733-d9ee-40b3-adb6-10ffd11bacf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f073e6-1487-43e9-a607-6ce23eaa387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5 (c32ddf78-10cc-4628-a611-3c7a8c75f3d5): created successfully
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f073e6-1487-43e9-a607-6ce23eaa387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (b395a465-c8cd-422d-af7a-dc76c5499342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6125f539-5b88-4810-b5cd-02dd0f1c3f0f tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created volume successfully.
Nov 05 04:02:26 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7
Nov 05 04:02:26 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" returned: 0 in 0.433s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb
Nov 05 04:02:26 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f 1073741824" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f
Nov 05 04:02:26 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:27 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:27 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50642697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60c3425-c601-4b18-bf12-4b40ad9180c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:26Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Creating volume e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:27 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:27 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 1073741824
Nov 05 04:02:27 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a9b418-636f-4c70-a169-1c0860111980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e11878-9260-4d54-9473-17a0afa10e7f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e8d51c-3322-49c3-8fb2-57dda81872e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb
Nov 05 04:02:27 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Volume volume-a1e11878-9260-4d54-9473-17a0afa10e7f (a1e11878-9260-4d54-9473-17a0afa10e7f): created successfully
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e8d51c-3322-49c3-8fb2-57dda81872e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Flow 'volume_create_manager' (8f783b79-dcaf-4fab-a42d-960990439a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-69737d9f-172b-4ec0-b4e2-bdd2bb52942c tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created volume successfully.
Nov 05 04:02:27 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7.4ff71960-78bf-457c-be44-ebfe1ff161cb" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-4ff71960-78bf-457c-be44-ebfe1ff161cb" released by "_delete_snapshot" :: held 1.614s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" released by "delete_snapshot" :: held 1.635s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Created reservations ['e456494a-74c5-4a33-ae09-14589a1e491c', '3a992bbd-ad3a-4f1f-90f5-2cb8d50980a1', 'b4dd0590-c735-4ab5-850a-0a1d3b38adb3', '587c7f3e-24c6-4f49-8b7f-f7325b959eb9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:02:27 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-22cc3ff5-263a-4ed2-823c-f0a7b3979190 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-4ff71960-78bf-457c-be44-ebfe1ff161cb-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 1073741824" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:27 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7
Nov 05 04:02:27 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:27 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7" returned: 0 in 0.265s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75755d90-c61b-4676-8e4d-4b39fe6a26ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e60c3425-c601-4b18-bf12-4b40ad9180c7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763bbcf4-c260-4578-a62a-1956860929b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-7ebe02b9-5b08-4c91-b69e-6e9138f623d7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:28 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Volume volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 (e60c3425-c601-4b18-bf12-4b40ad9180c7): created successfully
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763bbcf4-c260-4578-a62a-1956860929b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (929aa15d-bccc-4970-a6cf-c61f77fc624d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-7ebe02b9-5b08-4c91-b69e-6e9138f623d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-a1e11878-9260-4d54-9473-17a0afa10e7f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c547b8f1-f06b-47d7-b099-2ff123ef9ee2 tempest-ProjectReaderTests-787645029 None] Created volume successfully.
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-a1e11878-9260-4d54-9473-17a0afa10e7f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-quobyte-a1e11878-9260-4d54-9473-17a0afa10e7f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb5d4bb-805f-497c-b8aa-44713a85dc07]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-a1e11878-9260-4d54-9473-17a0afa10e7f" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[81015465-e68b-4144-9136-00504c0bc9de]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7
Nov 05 04:02:28 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f
Nov 05 04:02:28 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f" returned: 0 in 0.366s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" returned: 0 in 0.434s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f
Nov 05 04:02:28 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7
Nov 05 04:02:28 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-a1e11878-9260-4d54-9473-17a0afa10e7f" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-7ebe02b9-5b08-4c91-b69e-6e9138f623d7" released by "delete_volume" :: held 0.795s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-a1e11878-9260-4d54-9473-17a0afa10e7f" released by "delete_volume" :: held 0.741s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created reservations ['95483976-f557-4b42-bf8c-f3afdbd69894', '8cfa3343-5c08-426f-81eb-a9a338434613', 'ad59c8b0-24c5-4883-a6f2-259f909f4152', '4fc6e02c-ba52-49f2-ac0b-8ba9cc3cacde'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Created reservations ['5f1b076a-76a2-4b30-b573-108ab10bc688', 'f18b2dbd-a42c-4674-9d97-4bae8025b7b2', 'cb6e01a5-e5d6-44dc-8f01-20a155c7ed95', '41366ca4-fea7-4e99-920d-c06c64cfb174'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:29 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:29 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:29 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:29 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-c32ddf78-10cc-4628-a611-3c7a8c75f3d5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Creating offline snapshot 8c645150-9a52-4663-b717-5483327aaf6f of volume e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-c32ddf78-10cc-4628-a611-3c7a8c75f3d5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65039f1-b44f-4b20-9387-f324f4ffae8a]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-quobyte-c32ddf78-10cc-4628-a611-3c7a8c75f3d5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-c32ddf78-10cc-4628-a611-3c7a8c75f3d5" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51e22a9-9b2e-4a86-a8d0-506b4ab0b5fd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:29 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7
Nov 05 04:02:29 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:29 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.501s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:29 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5
Nov 05 04:02:29 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bb12abf-8b59-4962-b5a6-0a53ea454115 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-7ebe02b9-5b08-4c91-b69e-6e9138f623d7-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:29 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Deleted volume successfully.
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-636aa9fc-c8c1-4dbf-a492-a4d397578fd1 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-a1e11878-9260-4d54-9473-17a0afa10e7f-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (4c757dd9-2f15-4844-bd41-393f5b53edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145d66cd-b799-4520-90ba-eafe99ade563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145d66cd-b799-4520-90ba-eafe99ade563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189916410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e8de22-38cd-4b36-beab-82025819febc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:30Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032101c9-e0a2-4bed-8e6d-f59d666e3800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032101c9-e0a2-4bed-8e6d-f59d666e3800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92541140-d6b0-4aee-96f9-90e2438a18de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92541140-d6b0-4aee-96f9-90e2438a18de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e8de22-38cd-4b36-beab-82025819febc', 'volume_name': 'volume-44e8de22-38cd-4b36-beab-82025819febc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4785ea9-816d-4115-9071-d16b8d0080fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4785ea9-816d-4115-9071-d16b8d0080fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c53bea6-d36b-46d2-b8bd-6671aa641ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Volume 44e8de22-38cd-4b36-beab-82025819febc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e8de22-38cd-4b36-beab-82025819febc', 'volume_size': 1}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7" returned: 0 in 0.695s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5
Nov 05 04:02:30 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:30 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f 1G
Nov 05 04:02:30 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:30 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-c32ddf78-10cc-4628-a611-3c7a8c75f3d5" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-c32ddf78-10cc-4628-a611-3c7a8c75f3d5" released by "delete_volume" :: held 0.830s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created reservations ['c60f7eeb-3d68-480a-b0ef-be505c5b5a70', 'bae5876b-ed67-48f8-acbb-ba9b377bc1bc', 'f53c8d44-6a81-42f6-ac19-e222f01c38c1', '97251bd3-6ef2-4267-ad2b-b2f44d4e2e59'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:30 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:30 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f 1G" returned: 0 in 0.472s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f
Nov 05 04:02:30 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:30 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.274s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Deleted volume successfully.
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f1e4a3-1a32-4499-a9f7-ed9314eace57 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-c32ddf78-10cc-4628-a611-3c7a8c75f3d5-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:30 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f is being set with open permissions: ugo+rw
Nov 05 04:02:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f
Nov 05 04:02:30 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:31 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=202,cinder:UPDATE=267,cinder:INSERT=73,cinder:DELETE=31 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:31 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.info
Nov 05 04:02:31 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:31 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.info" returned: 0 in 0.247s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:31 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.info is being set with open permissions: ugo+rw
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:31 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.info
Nov 05 04:02:31 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-5f58ace3-1068-468e-895c-da3b799888c9-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-5f58ace3-1068-468e-895c-da3b799888c9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=222,cinder:UPDATE=269,cinder:INSERT=72,cinder:DELETE=18 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-quobyte-5f58ace3-1068-468e-895c-da3b799888c9" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:31 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-5f58ace3-1068-468e-895c-da3b799888c9" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.info" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d3134c-2298-44a3-ac21-aafd221c93d7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189916410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e8de22-38cd-4b36-beab-82025819febc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:30Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Creating volume 44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:31 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:31 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc 1073741824
Nov 05 04:02:31 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-27a33d8a-e351-4f21-a39f-0aaf06dd0b88 tempest-ProjectReaderTests-787645029 None] Create snapshot completed successfully
Nov 05 04:02:31 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9
Nov 05 04:02:31 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:32 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9" returned: 0 in 0.432s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:32 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc 1073741824" returned: 0 in 0.455s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:32 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9
Nov 05 04:02:32 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:32 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc
Nov 05 04:02:32 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:32 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-5f58ace3-1068-468e-895c-da3b799888c9" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-5f58ace3-1068-468e-895c-da3b799888c9" released by "delete_volume" :: held 0.774s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:32 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c53bea6-d36b-46d2-b8bd-6671aa641ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e8de22-38cd-4b36-beab-82025819febc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88ba166-3b17-4b7b-8682-88a543a3411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created reservations ['d78031fd-b615-4d0d-9f56-45d0354a93f0', '2de9cdcc-1be2-4535-b364-8e1105bafad0', 'e7ff2862-da79-4683-8b3f-b5bb9736f4e8', 'f6df89a4-60c0-43a6-9779-b6074238673e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Volume volume-44e8de22-38cd-4b36-beab-82025819febc (44e8de22-38cd-4b36-beab-82025819febc): created successfully
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88ba166-3b17-4b7b-8682-88a543a3411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (4c757dd9-2f15-4844-bd41-393f5b53edbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-8c645150-9a52-4663-b717-5483327aaf6f-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fe20ea77-cf93-496f-be43-442e8fa0da6d tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Lock "cinder-8c645150-9a52-4663-b717-5483327aaf6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-e60c3425-c601-4b18-bf12-4b40ad9180c7" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-e60c3425-c601-4b18-bf12-4b40ad9180c7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-8c645150-9a52-4663-b717-5483327aaf6f" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-8c645150-9a52-4663-b717-5483327aaf6f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Deleting offline snapshot 8c645150-9a52-4663-b717-5483327aaf6f of volume e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] snapshot_file for this snap is: volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc0239-e54f-43ba-bf98-d1141d55a326]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:32 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:32 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-65c7ff65-5ce9-4d05-bb8f-21e90f230426-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-65c7ff65-5ce9-4d05-bb8f-21e90f230426-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-quobyte-65c7ff65-5ce9-4d05-bb8f-21e90f230426" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-65c7ff65-5ce9-4d05-bb8f-21e90f230426" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc9a3b7-ba98-4751-843a-7c351b2d0c71]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:32 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f
Nov 05 04:02:32 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:32 devstack sudo[105693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426
Nov 05 04:02:33 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Deleted volume successfully.
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d9ac0c33-835c-4c15-ac8a-dffc50e9c4f8 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-5f58ace3-1068-468e-895c-da3b799888c9-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:33 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e60c3425-c601-4b18-bf12-4b40ad9180c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f645fba0-22bc-4fd5-9095-c7aa3dcd0966]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 267d365b-3169-4006-a916-5ccfa145db16 of volume 44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf9120e-af9f-4f76-9906-a1fd009c41ad]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack sudo[105701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7
Nov 05 04:02:33 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426" returned: 0 in 0.502s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426
Nov 05 04:02:33 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc
Nov 05 04:02:33 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7" returned: 0 in 0.446s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-65c7ff65-5ce9-4d05-bb8f-21e90f230426" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-65c7ff65-5ce9-4d05-bb8f-21e90f230426" released by "delete_volume" :: held 0.884s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:33 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f
Nov 05 04:02:33 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc" returned: 0 in 0.478s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created reservations ['7af5bec2-1bc4-4c36-9dd4-d50d1fd15afa', 'c64d5ab6-1c2e-4227-91ce-ede25873e1ce', 'bcad9de5-5512-479b-927b-b77ee7dcf2a7', '5f18594c-d3d1-416d-87c6-1363588149c9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:33 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 1G
Nov 05 04:02:33 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:33 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-0de24b79-f396-4323-9392-62c1f1eefd8e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-0de24b79-f396-4323-9392-62c1f1eefd8e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-quobyte-0de24b79-f396-4323-9392-62c1f1eefd8e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:34 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f" returned: 0 in 0.438s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-0de24b79-f396-4323-9392-62c1f1eefd8e" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:34 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f
Nov 05 04:02:34 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b610f8-1789-4c4a-a332-d99828406ac3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Deleted volume successfully.
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-33771c29-1164-4d58-b5e4-bf9e274d6318 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-65c7ff65-5ce9-4d05-bb8f-21e90f230426-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:34 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e
Nov 05 04:02:34 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 1G" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e8de22-38cd-4b36-beab-82025819febc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e8de22-38cd-4b36-beab-82025819febc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16
Nov 05 04:02:34 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7.8c645150-9a52-4663-b717-5483327aaf6f" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-8c645150-9a52-4663-b717-5483327aaf6f" released by "_delete_snapshot" :: held 1.852s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-e60c3425-c601-4b18-bf12-4b40ad9180c7" released by "delete_snapshot" :: held 1.901s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Created reservations ['0d2b8cc2-07d1-4f83-a23e-9ad047f15ff1', '68b6a19c-ff71-42bb-97a2-aec9b442d1cb', '33e041a6-aeac-4acd-875a-952b2f00f1fb', '0133e1e9-39ce-4c14-bac9-368549e4bd37'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:34 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e8de22-38cd-4b36-beab-82025819febc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 is being set with open permissions: ugo+rw
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Delete snapshot completed successfully.
Nov 05 04:02:34 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16
Nov 05 04:02:34 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-404e692f-2d95-4e6e-aa29-b8b15734e106 tempest-ProjectReaderTests-787645029 None] Lock "cinder-8c645150-9a52-4663-b717-5483327aaf6f-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e" returned: 0 in 0.525s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e
Nov 05 04:02:34 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-e60c3425-c601-4b18-bf12-4b40ad9180c7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Lock "cinder-e60c3425-c601-4b18-bf12-4b40ad9180c7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-e60c3425-c601-4b18-bf12-4b40ad9180c7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-e60c3425-c601-4b18-bf12-4b40ad9180c7" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[603d96c7-577a-404d-a137-2bf6754dff90]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-0de24b79-f396-4323-9392-62c1f1eefd8e" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-0de24b79-f396-4323-9392-62c1f1eefd8e" released by "delete_volume" :: held 0.860s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7
Nov 05 04:02:35 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.info
Nov 05 04:02:35 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created reservations ['fd4e58e7-695f-4d96-a149-0b49f7ddd51a', 'a13c100c-2fb9-46eb-9d18-f578a5b306e5', '288e5d7a-60c6-475f-8d19-ac2652b3f2c2', '10738154-c725-48bd-80b9-7f3a24c3a785'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:35 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.info" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.info is being set with open permissions: ugo+rw
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.info
Nov 05 04:02:35 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7
Nov 05 04:02:35 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Deleted volume successfully.
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fad4ad0-20ac-4d47-9bb2-edabb71cb3f3 tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-0de24b79-f396-4323-9392-62c1f1eefd8e-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:35 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e60c3425-c601-4b18-bf12-4b40ad9180c7" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-e60c3425-c601-4b18-bf12-4b40ad9180c7" released by "delete_volume" :: held 0.845s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:35 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.info" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-12868bc7-e409-4cf2-8163-c945225a4565 tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Created reservations ['6c7a9ad9-d654-442d-9527-9b3db98bcbf5', 'dfb06311-95f0-4f6e-8b7a-d5f1c672c132', '597c92c2-0c6f-43ee-9db7-a31f3f49c90a', 'cf472b93-6300-41a5-a059-939c234f14da'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:35 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Deleted volume successfully.
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-510701db-3fee-4194-90fb-5df07dfda0d6 tempest-ProjectReaderTests-787645029 None] Lock "cinder-e60c3425-c601-4b18-bf12-4b40ad9180c7-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "cinder-quobyte-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-267d365b-3169-4006-a916-5ccfa145db16-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad804544-f205-4099-b1d6-81aa7b40ebdf]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-267d365b-3169-4006-a916-5ccfa145db16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-44e8de22-38cd-4b36-beab-82025819febc" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-44e8de22-38cd-4b36-beab-82025819febc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-267d365b-3169-4006-a916-5ccfa145db16" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (dfa3517f-c758-4937-a330-c85ab30e4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845c40f3-1a1d-437a-9253-4fd309f64a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-267d365b-3169-4006-a916-5ccfa145db16" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 267d365b-3169-4006-a916-5ccfa145db16 of volume 44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:36 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f
Nov 05 04:02:36 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845c40f3-1a1d-437a-9253-4fd309f64a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1946775963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef04075-4d16-4dff-8631-56647995a7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:36Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c942bd-e668-4977-8b41-ac862456d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c942bd-e668-4977-8b41-ac862456d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20360c08-7a22-441b-8383-29962e685173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20360c08-7a22-441b-8383-29962e685173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef04075-4d16-4dff-8631-56647995a7bc', 'volume_name': 'volume-7ef04075-4d16-4dff-8631-56647995a7bc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1e1689-faad-4402-9f1f-7e4fe1d4d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1e1689-faad-4402-9f1f-7e4fe1d4d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13792a0-a037-4f96-b72e-7451b0323d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Volume 7ef04075-4d16-4dff-8631-56647995a7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef04075-4d16-4dff-8631-56647995a7bc', 'volume_size': 1}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1946775963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef04075-4d16-4dff-8631-56647995a7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:36Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Creating volume 7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:36 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[001295f9-a93c-4897-aeb5-7c7a3c4fd615]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc 1073741824
Nov 05 04:02:36 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16
Nov 05 04:02:36 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f
Nov 05 04:02:36 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e8de22-38cd-4b36-beab-82025819febc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f73611-f364-47fb-b2f3-1c49db7abe16]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc 1073741824" returned: 0 in 0.487s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-quobyte-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f" released by "delete_volume" :: held 0.801s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:37 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc
Nov 05 04:02:37 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc
Nov 05 04:02:37 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Created reservations ['ffb3ebf2-f982-47c5-9f9e-ed9d713c123e', '32c167fc-424d-4366-82a6-073efaf59e52', '4990ca32-2fa7-4051-837e-62208bf31d4a', '7f3cd6c4-dc2a-4fe8-83b6-969e79b95385'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:37 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc" returned: 0 in 0.495s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13792a0-a037-4f96-b72e-7451b0323d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef04075-4d16-4dff-8631-56647995a7bc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:37 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ede269-83d9-4fc0-ab26-88d98b94ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:37 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Volume volume-7ef04075-4d16-4dff-8631-56647995a7bc (7ef04075-4d16-4dff-8631-56647995a7bc): created successfully
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ede269-83d9-4fc0-ab26-88d98b94ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (dfa3517f-c758-4937-a330-c85ab30e4afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c46abc1a-783c-46da-a52b-df55c1d29c08 tempest-ProjectReaderTests-787645029 None] Created volume successfully.
Nov 05 04:02:37 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Deleted volume successfully.
Nov 05 04:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5414b7fe-8f36-4de6-b246-ca2dab12b2cf tempest-CreateVolumesFromSourceVolumeTest-928485488 None] Lock "cinder-e3da5e40-a88a-4bd3-b3a9-68eb0d72883f-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:38 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:38 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16
Nov 05 04:02:38 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:38 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc.267d365b-3169-4006-a916-5ccfa145db16" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-267d365b-3169-4006-a916-5ccfa145db16" released by "_delete_snapshot" :: held 1.787s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-44e8de22-38cd-4b36-beab-82025819febc" released by "delete_snapshot" :: held 1.846s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Created reservations ['cefb4be6-ac0b-4fed-9b74-35382aa2d784', 'dedefe1c-6987-4464-ad68-65a036266ba9', '6592d911-433d-4d4d-9064-34927ae26960', '2f7a5570-f326-4e10-a52e-c596f11e1401'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8668edaa-81a9-4ff3-ac76-fb7bd621bd51 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-267d365b-3169-4006-a916-5ccfa145db16-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-44e8de22-38cd-4b36-beab-82025819febc-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-44e8de22-38cd-4b36-beab-82025819febc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-44e8de22-38cd-4b36-beab-82025819febc" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-44e8de22-38cd-4b36-beab-82025819febc" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Creating offline snapshot 26b958f9-9010-46e8-ae27-a5124683bc82 of volume 7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba0ccdd-06c4-410e-8ec3-31826294eee4]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e71e8a-4b67-4a49-a327-00b38da21c5b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc
Nov 05 04:02:39 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc
Nov 05 04:02:39 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc
Nov 05 04:02:39 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 1G
Nov 05 04:02:39 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-44e8de22-38cd-4b36-beab-82025819febc" returned: 0 in 0.266s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-44e8de22-38cd-4b36-beab-82025819febc" released by "delete_volume" :: held 0.764s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Created reservations ['a4675537-21e3-4469-a5bf-1b7e72359807', '34603f48-9088-445b-82a1-37525a7119f6', '9f969531-3ccd-4cc5-9ee5-2600c7b68143', 'df5413a7-d2fd-432d-b4c1-ffb3de780cfd'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:39 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 1G" returned: 0 in 0.514s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef04075-4d16-4dff-8631-56647995a7bc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef04075-4d16-4dff-8631-56647995a7bc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82
Nov 05 04:02:39 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:40 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f2c1696a-fd91-4231-b00e-c6f264931951 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-44e8de22-38cd-4b36-beab-82025819febc-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:40 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef04075-4d16-4dff-8631-56647995a7bc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:40 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 is being set with open permissions: ugo+rw
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:40 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82
Nov 05 04:02:40 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (1ef3dbb5-d8f2-47dc-93e7-130b17e8507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:40 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e914cde3-388b-4215-91fa-8b6acfcae927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82" returned: 0 in 0.293s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e914cde3-388b-4215-91fa-8b6acfcae927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724135979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10825f96-d2f9-49a3-b8bf-71a91902eb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:40Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae5183f-cc1f-4e0c-bf1a-dc0ebe3b4c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae5183f-cc1f-4e0c-bf1a-dc0ebe3b4c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94970d1-53ba-467d-bb35-42021baa985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94970d1-53ba-467d-bb35-42021baa985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10825f96-d2f9-49a3-b8bf-71a91902eb9b', 'volume_name': 'volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450aa48a-5f8d-4056-9697-9551f7c9e41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450aa48a-5f8d-4056-9697-9551f7c9e41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27165dc9-85ed-45ed-b217-592fb99798e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Volume 10825f96-d2f9-49a3-b8bf-71a91902eb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b', 'volume_size': 1}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:40 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.info
Nov 05 04:02:40 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:40 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.info" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:40 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.info is being set with open permissions: ugo+rw
Nov 05 04:02:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:40 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.info
Nov 05 04:02:40 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.info" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724135979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10825f96-d2f9-49a3-b8bf-71a91902eb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:40Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Creating volume 10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:41 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:41 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b 1073741824
Nov 05 04:02:41 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fdc3b8d5-29ee-4978-8d64-c5f6df72b35b tempest-ProjectReaderTests-787645029 None] Create snapshot completed successfully
Nov 05 04:02:41 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b 1073741824" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:41 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b
Nov 05 04:02:41 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27165dc9-85ed-45ed-b217-592fb99798e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4bc4c9-8f80-400c-aa99-78a5960d1e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Volume volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b (10825f96-d2f9-49a3-b8bf-71a91902eb9b): created successfully
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4bc4c9-8f80-400c-aa99-78a5960d1e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (1ef3dbb5-d8f2-47dc-93e7-130b17e8507f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fcd99e09-19fc-40b4-b96c-35b4a670340e tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-26b958f9-9010-46e8-ae27-a5124683bc82-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Lock "cinder-26b958f9-9010-46e8-ae27-a5124683bc82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-7ef04075-4d16-4dff-8631-56647995a7bc" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-7ef04075-4d16-4dff-8631-56647995a7bc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-26b958f9-9010-46e8-ae27-a5124683bc82" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-26b958f9-9010-46e8-ae27-a5124683bc82" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Deleting offline snapshot 26b958f9-9010-46e8-ae27-a5124683bc82 of volume 7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] snapshot_file for this snap is: volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5784e57-5fcb-48ca-a14e-0ebeb6cb1e2b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:42 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82
Nov 05 04:02:42 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:42 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ef04075-4d16-4dff-8631-56647995a7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[401c777a-3a41-412b-94dc-25425a2307e3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:42 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc
Nov 05 04:02:42 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 491ddc4b-39df-46d6-b0e2-957eada78572 of volume 10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a7e45d-5e09-4e4b-b141-616651140414]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:43 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b
Nov 05 04:02:43 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:43 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc" returned: 0 in 0.434s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:43 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82
Nov 05 04:02:43 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:43 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b" returned: 0 in 0.434s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:43 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 1G
Nov 05 04:02:43 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:43 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:43 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82
Nov 05 04:02:43 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:43 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc.26b958f9-9010-46e8-ae27-a5124683bc82" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:43 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 1G" returned: 0 in 0.528s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-26b958f9-9010-46e8-ae27-a5124683bc82" released by "_delete_snapshot" :: held 1.726s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-7ef04075-4d16-4dff-8631-56647995a7bc" released by "delete_snapshot" :: held 1.760s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:43 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572
Nov 05 04:02:43 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:43 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Created reservations ['66401f85-4b82-44c0-9e84-ecb1613fa13e', 'ba5f9679-b5f3-42c0-ae20-77b2eb9176c2', '13d9ba4f-b877-44b4-b715-6a653cc1f7dd', '14b486b6-8836-4993-9c79-90876562d2d3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:44 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Delete snapshot completed successfully.
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f84e8023-8366-42fd-ab65-f70b36cff46d tempest-ProjectReaderTests-787645029 None] Lock "cinder-26b958f9-9010-46e8-ae27-a5124683bc82-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:44 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572" returned: 0 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:44 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 is being set with open permissions: ugo+rw
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572
Nov 05 04:02:44 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-7ef04075-4d16-4dff-8631-56647995a7bc-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Lock "cinder-7ef04075-4d16-4dff-8631-56647995a7bc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-7ef04075-4d16-4dff-8631-56647995a7bc" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-7ef04075-4d16-4dff-8631-56647995a7bc" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b6894a-f5c2-4c51-ba8c-4f0f7875e368]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.info
Nov 05 04:02:44 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:44 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc
Nov 05 04:02:44 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:44 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.info" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:44 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.info is being set with open permissions: ugo+rw
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.info
Nov 05 04:02:44 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:44 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc" returned: 0 in 0.420s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc
Nov 05 04:02:44 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:45 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.info" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:45 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-7ef04075-4d16-4dff-8631-56647995a7bc" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-255005c2-37df-4699-bb34-b59b546a14f1 tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-7ef04075-4d16-4dff-8631-56647995a7bc" released by "delete_volume" :: held 0.796s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Created reservations ['36d91484-3906-4bd1-9c09-979ea6610ee3', '192273a0-f94c-417b-b660-8de17dfa95b6', '1ee79ee5-dd98-4677-a0ff-9a771251ed76', '4d098471-7b19-4040-9cb7-b12f60c8b875'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:45 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:45 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:45 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.266s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Deleted volume successfully.
Nov 05 04:02:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9f29f576-8598-4ef0-8e36-428410aa733b tempest-ProjectReaderTests-787645029 None] Lock "cinder-7ef04075-4d16-4dff-8631-56647995a7bc-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-491ddc4b-39df-46d6-b0e2-957eada78572-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-491ddc4b-39df-46d6-b0e2-957eada78572-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-10825f96-d2f9-49a3-b8bf-71a91902eb9b" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (ff60016a-b524-4d54-b6cb-11906ed8199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8571ae53-3d9c-4c67-a39d-a36b7733b310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-10825f96-d2f9-49a3-b8bf-71a91902eb9b" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-491ddc4b-39df-46d6-b0e2-957eada78572" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8571ae53-3d9c-4c67-a39d-a36b7733b310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1455261535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae14384c-6502-4d10-a90d-b781979ca894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:46Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e020486-6b56-46a5-8039-5b5b6ebdd202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e020486-6b56-46a5-8039-5b5b6ebdd202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a17bca0-a17c-4a8a-8ba2-6bba6e08afd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a17bca0-a17c-4a8a-8ba2-6bba6e08afd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae14384c-6502-4d10-a90d-b781979ca894', 'volume_name': 'volume-ae14384c-6502-4d10-a90d-b781979ca894', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3a5076-c754-4a3f-a7ff-e8dce809549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3a5076-c754-4a3f-a7ff-e8dce809549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29685319-6b26-4843-a22e-c3bfe03036ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Volume ae14384c-6502-4d10-a90d-b781979ca894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae14384c-6502-4d10-a90d-b781979ca894', 'volume_size': 1}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1455261535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae14384c-6502-4d10-a90d-b781979ca894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:46Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Creating volume ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:46 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-491ddc4b-39df-46d6-b0e2-957eada78572" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 491ddc4b-39df-46d6-b0e2-957eada78572 of volume 10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:46 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 1073741824
Nov 05 04:02:46 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba79f64a-c844-4054-af19-0dc596b8a508]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:46 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572
Nov 05 04:02:46 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:46 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 1073741824" returned: 0 in 0.555s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:46 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572" returned: 0 in 0.503s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562745f-fb19-4cc4-810b-2d0ce8296ded]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:46 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894
Nov 05 04:02:46 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:46 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b
Nov 05 04:02:46 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:47 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29685319-6b26-4843-a22e-c3bfe03036ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae14384c-6502-4d10-a90d-b781979ca894', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc0cdd1-8d60-4f49-9378-0da8ec2fb239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Volume volume-ae14384c-6502-4d10-a90d-b781979ca894 (ae14384c-6502-4d10-a90d-b781979ca894): created successfully
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc0cdd1-8d60-4f49-9378-0da8ec2fb239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (ff60016a-b524-4d54-b6cb-11906ed8199a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-eb6b53e5-0790-4a62-988b-438862186a58 tempest-ProjectReaderTests-787645029 None] Created volume successfully.
Nov 05 04:02:47 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:47 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572
Nov 05 04:02:47 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:47 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:47 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572
Nov 05 04:02:47 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:47 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b.491ddc4b-39df-46d6-b0e2-957eada78572" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-491ddc4b-39df-46d6-b0e2-957eada78572" released by "_delete_snapshot" :: held 1.680s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-10825f96-d2f9-49a3-b8bf-71a91902eb9b" released by "delete_snapshot" :: held 1.774s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Created reservations ['5c01c980-ef94-40c6-b53c-78ebacafa76e', '3f24a1d4-f269-4569-8db7-5a9f51a0f458', '08c346e1-0a96-40ce-abad-9d7265fadb69', '70951b0e-5e73-4b4b-91bb-7ba380058053'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3df871-be4b-431c-80a7-047332ba82a1 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-491ddc4b-39df-46d6-b0e2-957eada78572-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Creating offline snapshot f60ec684-dcfd-457a-b27d-342ef8ae4547 of volume ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f433e31-abdd-4026-a53e-218fdd15d008]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-10825f96-d2f9-49a3-b8bf-71a91902eb9b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Lock "cinder-10825f96-d2f9-49a3-b8bf-71a91902eb9b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:48 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894
Nov 05 04:02:48 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-10825f96-d2f9-49a3-b8bf-71a91902eb9b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-10825f96-d2f9-49a3-b8bf-71a91902eb9b" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eb7573-876b-49a0-83d5-6d2c6d792d82]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:48 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b
Nov 05 04:02:48 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:48 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894" returned: 0 in 0.463s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:48 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 1G
Nov 05 04:02:48 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:49 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b" returned: 0 in 0.438s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:49 devstack sudo[105996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b
Nov 05 04:02:49 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:49 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 1G" returned: 0 in 0.452s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae14384c-6502-4d10-a90d-b781979ca894 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:49 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae14384c-6502-4d10-a90d-b781979ca894 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547
Nov 05 04:02:49 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:49 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-10825f96-d2f9-49a3-b8bf-71a91902eb9b" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-10825f96-d2f9-49a3-b8bf-71a91902eb9b" released by "delete_volume" :: held 0.820s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Created reservations ['27c3a98b-dd2f-4621-a901-7b6f13a92fc5', '043c9117-a0a4-402d-9c75-31198007c3d0', 'e06c3d39-f149-4337-addf-7951b75bc24a', '426f2cdb-cf68-4679-a103-7ff1afcda4a7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:49 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:49 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:49 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae14384c-6502-4d10-a90d-b781979ca894 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:49 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 is being set with open permissions: ugo+rw
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:49 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547
Nov 05 04:02:49 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:49 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:02:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7ba1b7d0-7da7-44ef-9cd2-441a97a5ffbb tempest-ProjectMemberTests-1514496126 None] Lock "cinder-10825f96-d2f9-49a3-b8bf-71a91902eb9b-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:50 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:50 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.info
Nov 05 04:02:50 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (36e540f5-9687-4f55-96c8-8012709be9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dae8c1-a38a-4f7f-b05d-1eba75144128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dae8c1-a38a-4f7f-b05d-1eba75144128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169889804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a42e768-6285-476a-bfca-6bf6b2a76089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:50Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb65ba73-b291-48e9-a3da-0d7a0ada1ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb65ba73-b291-48e9-a3da-0d7a0ada1ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4319cc5f-f3b6-42d0-b0cd-47d4445e7cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4319cc5f-f3b6-42d0-b0cd-47d4445e7cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a42e768-6285-476a-bfca-6bf6b2a76089', 'volume_name': 'volume-2a42e768-6285-476a-bfca-6bf6b2a76089', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bf019d-06fb-42fa-b1cb-1978165f6a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bf019d-06fb-42fa-b1cb-1978165f6a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9da2ea-c8ed-4c60-b182-a4977f0064e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Volume 2a42e768-6285-476a-bfca-6bf6b2a76089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a42e768-6285-476a-bfca-6bf6b2a76089', 'volume_size': 1}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:50 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.info" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:50 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.info is being set with open permissions: ugo+rw
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:50 devstack sudo[106016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.info
Nov 05 04:02:50 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:50 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.info" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169889804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a42e768-6285-476a-bfca-6bf6b2a76089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:50Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Creating volume 2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:50 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:50 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 1073741824
Nov 05 04:02:50 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-13ae9986-09c5-4d5d-bce6-af7d3554b60f tempest-ProjectReaderTests-787645029 None] Create snapshot completed successfully
Nov 05 04:02:51 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 1073741824" returned: 0 in 0.494s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:51 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089
Nov 05 04:02:51 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:51 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089" returned: 0 in 0.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9da2ea-c8ed-4c60-b182-a4977f0064e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a42e768-6285-476a-bfca-6bf6b2a76089', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2d2cce-8977-4a54-a31a-503084705e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Volume volume-2a42e768-6285-476a-bfca-6bf6b2a76089 (2a42e768-6285-476a-bfca-6bf6b2a76089): created successfully
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2d2cce-8977-4a54-a31a-503084705e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (36e540f5-9687-4f55-96c8-8012709be9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fdd595f4-3c27-4909-9003-fd24519a9eff tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-f60ec684-dcfd-457a-b27d-342ef8ae4547-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Lock "cinder-f60ec684-dcfd-457a-b27d-342ef8ae4547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-ae14384c-6502-4d10-a90d-b781979ca894" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ae14384c-6502-4d10-a90d-b781979ca894" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-f60ec684-dcfd-457a-b27d-342ef8ae4547" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-f60ec684-dcfd-457a-b27d-342ef8ae4547" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Deleting offline snapshot f60ec684-dcfd-457a-b27d-342ef8ae4547 of volume ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] snapshot_file for this snap is: volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd713420-ea1f-4b0c-beaa-253e12cb466b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:51 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547
Nov 05 04:02:51 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:52 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae14384c-6502-4d10-a90d-b781979ca894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ffe5a-6c1d-477c-8ab8-1b77adc52b35]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:52 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894
Nov 05 04:02:52 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:52 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:52 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:52 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 6e8de211-0c7b-4937-b272-0109cbb44b1d of volume 2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e740ac-3b56-4c35-9270-30e674f87349]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:52 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089
Nov 05 04:02:52 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:52 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:52 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547
Nov 05 04:02:52 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:52 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089" returned: 0 in 0.427s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:53 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d 1G
Nov 05 04:02:53 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:53 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894.f60ec684-dcfd-457a-b27d-342ef8ae4547" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-f60ec684-dcfd-457a-b27d-342ef8ae4547" released by "_delete_snapshot" :: held 1.560s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ae14384c-6502-4d10-a90d-b781979ca894" released by "delete_snapshot" :: held 1.589s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Created reservations ['b716391e-0099-4632-bfce-f415c512b452', '00117b80-a590-4e91-a905-b72b44b462e6', '38d7b8af-7445-4693-9251-b737dff620fc', 'cb3ad93d-b027-4bee-88f1-9c542b93b65b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Delete snapshot completed successfully.
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-30b4dee1-1750-49f4-8211-d7e915b4650c tempest-ProjectReaderTests-787645029 None] Lock "cinder-f60ec684-dcfd-457a-b27d-342ef8ae4547-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:53 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d 1G" returned: 0 in 0.505s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a42e768-6285-476a-bfca-6bf6b2a76089 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:53 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a42e768-6285-476a-bfca-6bf6b2a76089 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d
Nov 05 04:02:53 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-ae14384c-6502-4d10-a90d-b781979ca894-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Lock "cinder-ae14384c-6502-4d10-a90d-b781979ca894-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:53 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a42e768-6285-476a-bfca-6bf6b2a76089 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:53 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d is being set with open permissions: ugo+rw
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-ae14384c-6502-4d10-a90d-b781979ca894" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:53 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d
Nov 05 04:02:53 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ae14384c-6502-4d10-a90d-b781979ca894" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d294464-378e-43f5-ac34-c0fb84265505]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:54 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894
Nov 05 04:02:54 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:54 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:54 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.info
Nov 05 04:02:54 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:54 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:54 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894
Nov 05 04:02:54 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:54 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.info" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.info is being set with open permissions: ugo+rw
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:54 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.info
Nov 05 04:02:54 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:54 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ae14384c-6502-4d10-a90d-b781979ca894" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ae14384c-6502-4d10-a90d-b781979ca894" released by "delete_volume" :: held 0.834s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:54 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.info" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Created reservations ['d4802dfd-04ca-4e57-a819-244dca0a7328', 'ed8cc5ed-9958-4c86-b0e8-e693a383be61', '9149f750-37a8-4f42-99dd-4efa665bbc96', '8db65533-7b1e-49d4-b76f-1ded934985cd'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c6047034-d826-483b-978e-1a4e07812377 tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:54 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:54 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:55 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.293s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Deleted volume successfully.
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fce409ef-af60-480d-ba7a-59b200479686 tempest-ProjectReaderTests-787645029 None] Lock "cinder-ae14384c-6502-4d10-a90d-b781979ca894-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (9cb45c6e-fdaf-44fc-a178-a5958c89b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e027b954-1fb0-4963-9754-0f2b177c38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e027b954-1fb0-4963-9754-0f2b177c38e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066109697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:55Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6cf826-25ef-43f2-9b20-339f58e180f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6cf826-25ef-43f2-9b20-339f58e180f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d367e39-2f92-4a00-a927-9ebfeb520e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d367e39-2f92-4a00-a927-9ebfeb520e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc', 'volume_name': 'volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015de45-04e9-4ac1-9fce-6a8ad0a434a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015de45-04e9-4ac1-9fce-6a8ad0a434a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2107a2-eaa0-4ad5-b45b-9d6bb9acb585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Volume ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc', 'volume_size': 1}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066109697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:55Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Creating volume ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:55 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:55 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc 1073741824
Nov 05 04:02:55 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-6e8de211-0c7b-4937-b272-0109cbb44b1d-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-6e8de211-0c7b-4937-b272-0109cbb44b1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-2a42e768-6285-476a-bfca-6bf6b2a76089" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-2a42e768-6285-476a-bfca-6bf6b2a76089" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-6e8de211-0c7b-4937-b272-0109cbb44b1d" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-6e8de211-0c7b-4937-b272-0109cbb44b1d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 6e8de211-0c7b-4937-b272-0109cbb44b1d of volume 2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559cbf6-1f30-488d-8a3b-f2a9db2b0fdc]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:55 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d
Nov 05 04:02:55 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc 1073741824" returned: 0 in 0.643s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:56 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc
Nov 05 04:02:56 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d" returned: 0 in 0.505s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a42e768-6285-476a-bfca-6bf6b2a76089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a1712-36dc-4d5c-b66e-523854055594]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:56 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089
Nov 05 04:02:56 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2107a2-eaa0-4ad5-b45b-9d6bb9acb585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48318844-b56a-4d69-b976-78b3097eabe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:56 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Volume volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc (ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc): created successfully
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48318844-b56a-4d69-b976-78b3097eabe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (9cb45c6e-fdaf-44fc-a178-a5958c89b599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c679506d-3644-4512-a8ef-27fdf9dff08e tempest-ProjectReaderTests-787645029 None] Created volume successfully.
Nov 05 04:02:56 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:56 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d
Nov 05 04:02:56 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Flow 'volume_create_manager' (143c1088-0d17-418a-8dd4-ba680198867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f282e8d5-32f0-4096-a69b-f3b91fd4e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f282e8d5-32f0-4096-a69b-f3b91fd4e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478067708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78641569-2e11-4da0-a648-d8d844524887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112a5b193e564b5584c2cb682aad03fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:57Z,use_quota=True,user_id='455da46cd653457288969b1818be2be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaa8eec-642c-4427-8399-1ed8ee1e160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaa8eec-642c-4427-8399-1ed8ee1e160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af159c8a-7cb2-4a07-a903-17f04ac5b8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af159c8a-7cb2-4a07-a903-17f04ac5b8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78641569-2e11-4da0-a648-d8d844524887', 'volume_name': 'volume-78641569-2e11-4da0-a648-d8d844524887', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f8b5cb-b86b-4034-ade2-f3a1f9377158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f8b5cb-b86b-4034-ade2-f3a1f9377158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b151882a-bdfa-4866-9185-5e81327322b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Volume 78641569-2e11-4da0-a648-d8d844524887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78641569-2e11-4da0-a648-d8d844524887', 'volume_size': 1}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478067708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78641569-2e11-4da0-a648-d8d844524887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112a5b193e564b5584c2cb682aad03fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:57Z,use_quota=True,user_id='455da46cd653457288969b1818be2be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Creating volume 78641569-2e11-4da0-a648-d8d844524887 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887 1073741824
Nov 05 04:02:57 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d
Nov 05 04:02:57 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089.6e8de211-0c7b-4937-b272-0109cbb44b1d" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-6e8de211-0c7b-4937-b272-0109cbb44b1d" released by "_delete_snapshot" :: held 1.747s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-2a42e768-6285-476a-bfca-6bf6b2a76089" released by "delete_snapshot" :: held 1.776s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:57 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887 1073741824" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Created reservations ['d76eca17-3751-4dcf-8eb1-999487cdf8b3', 'e75192e9-6c3c-45fa-9a08-eef0c37b6483', 'a18a8a41-bc17-4be2-82ad-ab393dadc8ee', 'c495efe6-d603-4d17-b2df-ff2f17e9503b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887
Nov 05 04:02:57 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0c26c29b-fb1a-4755-a500-3d94b7b797e5 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-6e8de211-0c7b-4937-b272-0109cbb44b1d-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-2a42e768-6285-476a-bfca-6bf6b2a76089-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Lock "cinder-2a42e768-6285-476a-bfca-6bf6b2a76089-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:57 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.168s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Creating offline snapshot 843aab11-7d0b-434e-9fdd-7508bcd55463 of volume ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-2a42e768-6285-476a-bfca-6bf6b2a76089" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b151882a-bdfa-4866-9185-5e81327322b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78641569-2e11-4da0-a648-d8d844524887', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73027f2-7abb-4133-ab36-5ecd40d05f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4da1af-08ec-4b61-8282-3d37de6dbad7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-2a42e768-6285-476a-bfca-6bf6b2a76089" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Volume volume-78641569-2e11-4da0-a648-d8d844524887 (78641569-2e11-4da0-a648-d8d844524887): created successfully
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73027f2-7abb-4133-ab36-5ecd40d05f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Flow 'volume_create_manager' (143c1088-0d17-418a-8dd4-ba680198867c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c3e7a8-8ed6-4563-a4b7-34140d11837c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7c8de318-af45-475a-9e8b-108f912f18a9 tempest-ProjectReaderTests-1712557487 None] Created volume successfully.
Nov 05 04:02:58 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc
Nov 05 04:02:58 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089
Nov 05 04:02:58 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 1G
Nov 05 04:02:58 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089
Nov 05 04:02:58 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2a42e768-6285-476a-bfca-6bf6b2a76089" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-2a42e768-6285-476a-bfca-6bf6b2a76089" released by "delete_volume" :: held 0.720s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Created reservations ['45cbb257-be65-4c6a-bcfa-1a1e0e894a12', '832dfb4f-a61f-4434-b4e2-de3c42c597a7', 'aef49a59-f73f-48c5-a529-5f9c7e0bac99', '02b01c6e-7f2e-4f29-b8c5-5ad96931515e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:58 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 1G" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463
Nov 05 04:02:58 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:02:58 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 is being set with open permissions: ugo+rw
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463
Nov 05 04:02:59 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88537429-9a20-4cab-9e70-2a07ff98781a tempest-ProjectMemberTests-1514496126 None] Lock "cinder-2a42e768-6285-476a-bfca-6bf6b2a76089-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Acquiring lock "cinder-78641569-2e11-4da0-a648-d8d844524887-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Lock "cinder-78641569-2e11-4da0-a648-d8d844524887-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Acquiring lock "cinder-quobyte-78641569-2e11-4da0-a648-d8d844524887" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:59 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Lock "cinder-quobyte-78641569-2e11-4da0-a648-d8d844524887" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463" returned: 0 in 0.383s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67c4f0-2889-45ac-98fc-a311a748b537]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.info
Nov 05 04:02:59 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:59 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887
Nov 05 04:02:59 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (c23353ee-c218-47c0-9dcf-d92d43361d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a1ef01-e33b-4509-8bd0-39343b636356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a1ef01-e33b-4509-8bd0-39343b636356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966560804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0ca62f-d5d5-4348-8836-cc99fb661ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:00Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ae37e9-2fde-4fd3-96cf-80c5afc7db58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ae37e9-2fde-4fd3-96cf-80c5afc7db58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c297d30-b48d-4608-a6e4-c3b5eb2c28f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c297d30-b48d-4608-a6e4-c3b5eb2c28f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0ca62f-d5d5-4348-8836-cc99fb661ca6', 'volume_name': 'volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba409c3-9975-41ec-9859-23095bedb541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba409c3-9975-41ec-9859-23095bedb541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c803813-21e0-46d3-8ab9-20a257bc9983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Volume bf0ca62f-d5d5-4348-8836-cc99fb661ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6', 'volume_size': 1}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:59 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.info" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.info is being set with open permissions: ugo+rw
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.info
Nov 05 04:02:59 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887
Nov 05 04:03:00 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:00 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.info" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966560804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0ca62f-d5d5-4348-8836-cc99fb661ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:00Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Creating volume bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 1073741824
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-78641569-2e11-4da0-a648-d8d844524887" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Lock "cinder-quobyte-78641569-2e11-4da0-a648-d8d844524887" released by "delete_volume" :: held 0.725s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1ef8e623-99e8-41c4-afd5-d0184e3fe84e tempest-ProjectReaderTests-787645029 None] Create snapshot completed successfully
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Created reservations ['a071b4a8-0e46-417e-b0d6-b3f79ffc4e56', '807124c1-6807-46ef-b235-7c160d4d868d', '613078fe-569d-4f81-bf59-5fea9c07e60f', '490aee4a-21af-43e5-a098-7f63db1a595f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:00 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:00 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 1073741824" returned: 0 in 0.508s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.337s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Deleted volume successfully.
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88f9e9cf-3518-46d2-807f-6cca2f5843ce tempest-ProjectReaderTests-1712557487 None] Lock "cinder-78641569-2e11-4da0-a648-d8d844524887-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6
Nov 05 04:03:00 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-843aab11-7d0b-434e-9fdd-7508bcd55463-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Lock "cinder-843aab11-7d0b-434e-9fdd-7508bcd55463-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:01 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c803813-21e0-46d3-8ab9-20a257bc9983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d9f81f-788c-4897-a6d5-bac9bde7cc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" acquired by "delete_snapshot" :: waited 0.104s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-843aab11-7d0b-434e-9fdd-7508bcd55463" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Flow 'volume_create_manager' (b717356b-29f1-4b2c-8796-305e1108d1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b4564a-55d5-4536-ae39-6892473b5367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Volume volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 (bf0ca62f-d5d5-4348-8836-cc99fb661ca6): created successfully
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d9f81f-788c-4897-a6d5-bac9bde7cc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (c23353ee-c218-47c0-9dcf-d92d43361d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-843aab11-7d0b-434e-9fdd-7508bcd55463" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Deleting offline snapshot 843aab11-7d0b-434e-9fdd-7508bcd55463 of volume ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] snapshot_file for this snap is: volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b4564a-55d5-4536-ae39-6892473b5367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019367278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2691400a-a7ee-456e-a358-622db7126d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112a5b193e564b5584c2cb682aad03fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:01Z,use_quota=True,user_id='455da46cd653457288969b1818be2be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0762aa4-924e-4886-a176-5458e786828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0762aa4-924e-4886-a176-5458e786828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ec34ce-615e-4f22-9a1d-00e25cf9b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ec34ce-615e-4f22-9a1d-00e25cf9b135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2691400a-a7ee-456e-a358-622db7126d05', 'volume_name': 'volume-2691400a-a7ee-456e-a358-622db7126d05', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cfcc35-3803-413b-a8b3-a101503cd33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cfcc35-3803-413b-a8b3-a101503cd33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a894fd3e-bc41-4e97-a960-3ce7c4bbe9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Volume 2691400a-a7ee-456e-a358-622db7126d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2691400a-a7ee-456e-a358-622db7126d05', 'volume_size': 1}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019367278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2691400a-a7ee-456e-a358-622db7126d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112a5b193e564b5584c2cb682aad03fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:01Z,use_quota=True,user_id='455da46cd653457288969b1818be2be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Creating volume 2691400a-a7ee-456e-a358-622db7126d05 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:01 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[34306128-827b-4f87-94f5-384c4f0342b3]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2348bf67-6f58-40d1-ad60-f3b183199f1f tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:03:01 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05 1073741824
Nov 05 04:03:01 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:01 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463
Nov 05 04:03:01 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:01 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463" returned: 0 in 0.413s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a087cc-9fa7-4166-ba76-a5a257025b60]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:01 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05 1073741824" returned: 0 in 0.502s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:01 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05
Nov 05 04:03:01 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:01 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc
Nov 05 04:03:01 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:02 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.151s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a894fd3e-bc41-4e97-a960-3ce7c4bbe9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2691400a-a7ee-456e-a358-622db7126d05', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7297bb-c5b2-485f-9d6c-efc07f6ad7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 598f5d7c-6266-419e-ae3c-b731989a84d4 of volume bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Volume volume-2691400a-a7ee-456e-a358-622db7126d05 (2691400a-a7ee-456e-a358-622db7126d05): created successfully
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7297bb-c5b2-485f-9d6c-efc07f6ad7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Flow 'volume_create_manager' (b717356b-29f1-4b2c-8796-305e1108d1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:02 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df49807-c4ed-4c8e-80ca-09fe94d7e285]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7043d5cf-1881-444e-92f9-7596327ca1e0 tempest-ProjectReaderTests-1712557487 None] Created volume successfully.
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:02 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463
Nov 05 04:03:02 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6
Nov 05 04:03:02 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:02 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:02 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463
Nov 05 04:03:02 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack sudo[106208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 1G
Nov 05 04:03:02 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc.843aab11-7d0b-434e-9fdd-7508bcd55463" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-843aab11-7d0b-434e-9fdd-7508bcd55463" released by "_delete_snapshot" :: held 1.672s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" released by "delete_snapshot" :: held 1.744s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:02 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Created reservations ['3a577178-e804-42a6-91e7-5c43878cb3a8', 'e464c72f-5eb7-48de-97c4-cdd2b235e4b6', '13029d2d-2f4e-45d2-a618-d7b3094255e9', '1c0fc961-d935-447b-8ae9-42a195681041'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Delete snapshot completed successfully.
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c29b5cc2-1fa5-4e2c-af42-292b95da6440 tempest-ProjectReaderTests-787645029 None] Lock "cinder-843aab11-7d0b-434e-9fdd-7508bcd55463-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:03 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 1G" returned: 0 in 0.455s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4
Nov 05 04:03:03 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Lock "cinder-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Acquiring lock "cinder-2691400a-a7ee-456e-a358-622db7126d05-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Lock "cinder-2691400a-a7ee-456e-a358-622db7126d05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21faa23-b970-4714-a053-82ef42b2affa]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Acquiring lock "cinder-quobyte-2691400a-a7ee-456e-a358-622db7126d05" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:03 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:03 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 is being set with open permissions: ugo+rw
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Lock "cinder-quobyte-2691400a-a7ee-456e-a358-622db7126d05" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:03 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4
Nov 05 04:03:03 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[65637503-4c79-4d4a-a97a-212a53efd3a5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc
Nov 05 04:03:03 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05
Nov 05 04:03:03 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4" returned: 0 in 0.280s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.info
Nov 05 04:03:03 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" returned: 0 in 0.493s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc
Nov 05 04:03:03 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05" returned: 0 in 0.446s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05
Nov 05 04:03:03 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.info" returned: 0 in 0.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.info is being set with open permissions: ugo+rw
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:04 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.info
Nov 05 04:03:04 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc" released by "delete_volume" :: held 0.840s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:04 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2691400a-a7ee-456e-a358-622db7126d05" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Created reservations ['f12ad1b9-2bff-477f-a508-8d01d1082863', '0aa8e185-6e5f-4db2-a44b-0ddf1df27300', '6d355cb4-da48-4703-a8a6-51df816d5c98', '1d802640-9a60-4e30-9536-dcd4dd0173db'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Lock "cinder-quobyte-2691400a-a7ee-456e-a358-622db7126d05" released by "delete_volume" :: held 0.803s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:04 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.info" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:04 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Created reservations ['cf1dc062-dfa6-4743-ac6a-16d24ccb13cf', 'f0c16ac0-a26b-4a9c-a607-6e9c701c5867', '650c31be-57a2-4073-bcb5-a459e09770c3', '3293fbc7-9b6a-4a09-bc61-60d0b1bfc870'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a4a1aeab-2112-45b8-b10f-c0c4f770768a tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:04 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:04 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.358s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Deleted volume successfully.
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f1a179ea-63b8-4885-9035-b39fc7c2b8a5 tempest-ProjectReaderTests-787645029 None] Lock "cinder-ac28bb6f-6708-444f-8fcf-f6a5d2b3e9dc-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:04 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Deleted volume successfully.
Nov 05 04:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2ed17267-35d0-4a12-8096-c0f0f5fad60b tempest-ProjectReaderTests-1712557487 None] Lock "cinder-2691400a-a7ee-456e-a358-622db7126d05-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (8a6a1d9e-93f9-4963-b00e-8a3ba2fb833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3f063f-714b-4dea-9a06-6dded4e5e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3f063f-714b-4dea-9a06-6dded4e5e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300239707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc759663-dc70-4123-bddb-905b51676cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:05Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6489d4-9398-4287-83c5-10547e439010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6489d4-9398-4287-83c5-10547e439010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3973483-64cf-4bd5-9edf-b7c681268196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3973483-64cf-4bd5-9edf-b7c681268196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc759663-dc70-4123-bddb-905b51676cb3', 'volume_name': 'volume-dc759663-dc70-4123-bddb-905b51676cb3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc7b4fa-e9fd-44d9-a0fa-221060041287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc7b4fa-e9fd-44d9-a0fa-221060041287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc62d574-aa95-4e5b-8f1b-346de5ef4b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Volume dc759663-dc70-4123-bddb-905b51676cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc759663-dc70-4123-bddb-905b51676cb3', 'volume_size': 1}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300239707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc759663-dc70-4123-bddb-905b51676cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ccfedd5f654d8f9087c9cbb0be01db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:05Z,use_quota=True,user_id='b8b6018c490847a6afabcd712dcec201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Creating volume dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:05 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 1073741824
Nov 05 04:03:05 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-598f5d7c-6266-419e-ae3c-b731989a84d4-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-598f5d7c-6266-419e-ae3c-b731989a84d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-598f5d7c-6266-419e-ae3c-b731989a84d4" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-598f5d7c-6266-419e-ae3c-b731989a84d4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 598f5d7c-6266-419e-ae3c-b731989a84d4 of volume bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e20c34-bbce-4b94-bb1d-48e71b2256fa]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:05 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4
Nov 05 04:03:05 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:05 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 1073741824" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:05 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3
Nov 05 04:03:05 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:05 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce8564f-bd44-41f8-8476-5952d0be94de]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:05 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6
Nov 05 04:03:05 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:05 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc62d574-aa95-4e5b-8f1b-346de5ef4b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc759663-dc70-4123-bddb-905b51676cb3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93d6425-ea0d-41e2-9940-2ba1c8b30d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Volume volume-dc759663-dc70-4123-bddb-905b51676cb3 (dc759663-dc70-4123-bddb-905b51676cb3): created successfully
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93d6425-ea0d-41e2-9940-2ba1c8b30d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Flow 'volume_create_manager' (8a6a1d9e-93f9-4963-b00e-8a3ba2fb833e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-188042ce-f9a4-4950-9cc2-8c409ed5655b tempest-ProjectReaderTests-787645029 None] Created volume successfully.
Nov 05 04:03:06 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" returned: 0 in 0.436s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:06 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4
Nov 05 04:03:06 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:06 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:06 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4
Nov 05 04:03:06 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:06 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6.598f5d7c-6266-419e-ae3c-b731989a84d4" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-598f5d7c-6266-419e-ae3c-b731989a84d4" released by "_delete_snapshot" :: held 1.604s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" released by "delete_snapshot" :: held 1.633s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Created reservations ['cf7f3d1e-30ea-46d1-82d6-6a3247d8e90d', '3d85df65-f9b8-4783-a2dc-cb1e12976094', '8482415d-daeb-4895-b15b-e5b656051f66', '1072c0aa-0a3f-4c3c-a84d-7cfb459873c8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fca2f743-fed7-401a-b0c7-5e61617f9bd4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-598f5d7c-6266-419e-ae3c-b731989a84d4-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Creating offline snapshot a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d of volume dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd8b052-3c23-4785-a1f0-db5daaa3e3e0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-bf0ca62f-d5d5-4348-8836-cc99fb661ca6-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-bf0ca62f-d5d5-4348-8836-cc99fb661ca6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:07 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3
Nov 05 04:03:07 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97230c-4402-4e2c-84c7-325341f61003]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:07 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6
Nov 05 04:03:07 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:07 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:07 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d 1G
Nov 05 04:03:07 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:08 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6
Nov 05 04:03:08 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:08 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d 1G" returned: 0 in 0.507s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc759663-dc70-4123-bddb-905b51676cb3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc759663-dc70-4123-bddb-905b51676cb3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d
Nov 05 04:03:08 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:08 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-bf0ca62f-d5d5-4348-8836-cc99fb661ca6" released by "delete_volume" :: held 0.801s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Created reservations ['b7578102-d228-42fe-abd4-d1031de47abf', '6f55fec6-8ae2-4da4-a23a-821258c157d5', '2d205a3f-976b-4875-a6c1-f0a8b3afe733', '9ddcaabd-1541-4776-afb4-ddf804e73f10'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:08 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:08 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc759663-dc70-4123-bddb-905b51676cb3 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:08 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d is being set with open permissions: ugo+rw
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d
Nov 05 04:03:08 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:08 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f425479-f415-474d-baef-3580bff17e21 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-bf0ca62f-d5d5-4348-8836-cc99fb661ca6-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:08 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.info
Nov 05 04:03:08 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (4ac42818-9322-4a3d-b508-204c89f5455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8334a2-caea-44ce-b49a-fb9694dff5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8334a2-caea-44ce-b49a-fb9694dff5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-744784462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23800864-b12f-4627-bd63-2681a3a5f1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:09Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a040f143-ad06-45a4-9711-99f14c348e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a040f143-ad06-45a4-9711-99f14c348e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07024a8-4379-4c3b-bbec-0e4fa3f316f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07024a8-4379-4c3b-bbec-0e4fa3f316f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23800864-b12f-4627-bd63-2681a3a5f1d2', 'volume_name': 'volume-23800864-b12f-4627-bd63-2681a3a5f1d2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb21371-216d-463c-8764-471432418142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb21371-216d-463c-8764-471432418142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0994ed-5859-40b3-8d60-83cd2856d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Volume 23800864-b12f-4627-bd63-2681a3a5f1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23800864-b12f-4627-bd63-2681a3a5f1d2', 'volume_size': 1}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.info" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:09 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.info is being set with open permissions: ugo+rw
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:09 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.info
Nov 05 04:03:09 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:09 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.info" returned: 0 in 0.262s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-744784462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23800864-b12f-4627-bd63-2681a3a5f1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:09Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Creating volume 23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:09 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:09 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 1073741824
Nov 05 04:03:09 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cf756b78-4383-4c1a-be7e-e104925c4f3e tempest-ProjectReaderTests-787645029 None] Create snapshot completed successfully
Nov 05 04:03:10 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 1073741824" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2
Nov 05 04:03:10 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:10 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0994ed-5859-40b3-8d60-83cd2856d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23800864-b12f-4627-bd63-2681a3a5f1d2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d380eeb5-e851-408a-842d-2eee7e605979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Volume volume-23800864-b12f-4627-bd63-2681a3a5f1d2 (23800864-b12f-4627-bd63-2681a3a5f1d2): created successfully
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d380eeb5-e851-408a-842d-2eee7e605979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (4ac42818-9322-4a3d-b508-204c89f5455a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4a0ce3cd-00ba-4dfc-91a3-d9bc2d33a3b6 tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-dc759663-dc70-4123-bddb-905b51676cb3" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-dc759663-dc70-4123-bddb-905b51676cb3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Deleting offline snapshot a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d of volume dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] snapshot_file for this snap is: volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d271f2-f97c-48f4-a64e-fcaa21719071]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d
Nov 05 04:03:10 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:10 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:10 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:11 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc759663-dc70-4123-bddb-905b51676cb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a2a14-1bb4-4bcc-97da-6f4c16192746]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3
Nov 05 04:03:11 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:11 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3" returned: 0 in 0.453s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot f3ff821e-9614-4494-8428-7a9493a95962 of volume 23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:11 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d
Nov 05 04:03:11 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[38de2edd-d122-459e-94e3-3167deedb223]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2
Nov 05 04:03:11 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d
Nov 05 04:03:11 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:12 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 1G
Nov 05 04:03:12 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3.a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d" released by "_delete_snapshot" :: held 1.710s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-dc759663-dc70-4123-bddb-905b51676cb3" released by "delete_snapshot" :: held 1.733s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Created reservations ['d5aae7d5-23e0-4acf-abe1-3c1a53dc04a9', '358c74de-83c0-495f-b521-c12f9396b871', '873f1d1b-38c0-4f61-9ed8-44056c43e5b5', '7f318737-5e19-4367-a527-bae33b3bb5a6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Delete snapshot completed successfully.
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f8f09-ea98-4cf3-a2ca-f852af00abfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-a9c1fb9d-90ac-4ffd-93b6-ad8b83c5288d-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:12 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 1G" returned: 0 in 0.523s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23800864-b12f-4627-bd63-2681a3a5f1d2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:12 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23800864-b12f-4627-bd63-2681a3a5f1d2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962
Nov 05 04:03:12 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-dc759663-dc70-4123-bddb-905b51676cb3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-dc759663-dc70-4123-bddb-905b51676cb3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Acquiring lock "cinder-quobyte-dc759663-dc70-4123-bddb-905b51676cb3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-dc759663-dc70-4123-bddb-905b51676cb3" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b551150f-d770-4884-b2ad-675f7f011d7b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:12 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23800864-b12f-4627-bd63-2681a3a5f1d2 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 is being set with open permissions: ugo+rw
Nov 05 04:03:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:12 devstack sudo[106366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962
Nov 05 04:03:12 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3
Nov 05 04:03:12 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:13 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:13 devstack sudo[106373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.info
Nov 05 04:03:13 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:13 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:13 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3
Nov 05 04:03:13 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:13 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.info" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.info is being set with open permissions: ugo+rw
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:13 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.info
Nov 05 04:03:13 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:13 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-dc759663-dc70-4123-bddb-905b51676cb3" returned: 0 in 0.254s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-quobyte-dc759663-dc70-4123-bddb-905b51676cb3" released by "delete_volume" :: held 0.712s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Created reservations ['56b84df8-049e-493f-9cab-29d4604a0532', '022428e9-2de8-490d-bd53-8a8b845b540d', '0c325d30-89d4-48a8-8526-2e3d238aa84b', '014b7ad5-bf3f-4f1c-b662-33cf5fc1347b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:13 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:13 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:13 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.info" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fd09dcb7-4e59-4a6c-8fdf-b3538d347799 tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:03:13 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.263s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Deleted volume successfully.
Nov 05 04:03:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-614172f9-49c4-4834-8c69-05bc53712cfe tempest-ProjectReaderTests-787645029 None] Lock "cinder-dc759663-dc70-4123-bddb-905b51676cb3-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-f3ff821e-9614-4494-8428-7a9493a95962-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-f3ff821e-9614-4494-8428-7a9493a95962-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-23800864-b12f-4627-bd63-2681a3a5f1d2" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-23800864-b12f-4627-bd63-2681a3a5f1d2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-f3ff821e-9614-4494-8428-7a9493a95962" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-f3ff821e-9614-4494-8428-7a9493a95962" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot f3ff821e-9614-4494-8428-7a9493a95962 of volume 23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b642f507-15a9-4d09-a63e-4741a91d3e77]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:14 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962
Nov 05 04:03:14 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:15 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962" returned: 0 in 0.439s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23800864-b12f-4627-bd63-2681a3a5f1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a98ad20-ba39-4cf1-a5e2-701d7f9180d1]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:15 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2
Nov 05 04:03:15 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:15 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:15 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962
Nov 05 04:03:15 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:16 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:16 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962
Nov 05 04:03:16 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:16 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2.f3ff821e-9614-4494-8428-7a9493a95962" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-f3ff821e-9614-4494-8428-7a9493a95962" released by "_delete_snapshot" :: held 1.588s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-23800864-b12f-4627-bd63-2681a3a5f1d2" released by "delete_snapshot" :: held 1.622s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Created reservations ['910e8fde-4936-485d-8030-c74fc1c52adb', '06d14417-e855-40b9-8055-ab9b01e92a04', 'eae68504-5e15-405d-9b46-b7993ab00ae2', '046ccee4-0bee-40f3-baab-f2ba03d4ffc4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ec52990-77ae-4a09-90be-c6fac4bc5997 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-f3ff821e-9614-4494-8428-7a9493a95962-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-23800864-b12f-4627-bd63-2681a3a5f1d2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-23800864-b12f-4627-bd63-2681a3a5f1d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-23800864-b12f-4627-bd63-2681a3a5f1d2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-23800864-b12f-4627-bd63-2681a3a5f1d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8c3b28-a8d2-44ab-bd31-bf46a8516b7c]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:17 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2
Nov 05 04:03:17 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:17 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:17 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2
Nov 05 04:03:17 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:17 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-23800864-b12f-4627-bd63-2681a3a5f1d2" returned: 0 in 0.263s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-23800864-b12f-4627-bd63-2681a3a5f1d2" released by "delete_volume" :: held 0.698s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Created reservations ['07872c60-f92a-4184-935b-4c24ce8953d3', '8793bae7-78b1-4ea7-a0b1-126b151d3acf', 'f386db32-6671-4e3e-ba1a-103a7dd99b30', 'abf7277b-e01b-440f-b564-25b9f1d697a3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:17 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:17 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (dd6f250a-bb68-45aa-a4bd-81d2614ad1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db091e1-954f-4a0a-8edd-14dc64d879dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db091e1-954f-4a0a-8edd-14dc64d879dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554616694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d9731b-9689-444b-8587-e594c62fe4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:18Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc7bf60-7dec-4bf0-827a-a7f53670bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc7bf60-7dec-4bf0-827a-a7f53670bd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8661fd5e-1839-45e4-8325-30b766262353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8661fd5e-1839-45e4-8325-30b766262353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d9731b-9689-444b-8587-e594c62fe4db', 'volume_name': 'volume-d8d9731b-9689-444b-8587-e594c62fe4db', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8961872d-a8f9-424d-ae8e-648d4e340b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8961872d-a8f9-424d-ae8e-648d4e340b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04b4912-5a70-4fee-aff2-aa77eb7ca7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Volume d8d9731b-9689-444b-8587-e594c62fe4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d9731b-9689-444b-8587-e594c62fe4db', 'volume_size': 1}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554616694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d9731b-9689-444b-8587-e594c62fe4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:18Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Creating volume d8d9731b-9689-444b-8587-e594c62fe4db {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:18 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db 1073741824
Nov 05 04:03:18 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:18 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aaaa3315-ccae-4fed-90c4-603749a5bca0 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-23800864-b12f-4627-bd63-2681a3a5f1d2-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:18 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db 1073741824" returned: 0 in 0.483s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:18 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db
Nov 05 04:03:18 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (3bffeaf4-771b-4039-a8c7-1eb6d8caeb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadeb904-b189-4b3e-8746-69d0916ce5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadeb904-b189-4b3e-8746-69d0916ce5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311783470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887cadd5-97fb-4fbe-99c7-3d4109c36a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:18Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e19114d-b466-4193-9d6e-122f8d97257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e19114d-b466-4193-9d6e-122f8d97257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da0231e-1bf7-44b9-a71e-a6001e2f12e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da0231e-1bf7-44b9-a71e-a6001e2f12e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887cadd5-97fb-4fbe-99c7-3d4109c36a4d', 'volume_name': 'volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d5fbd8-9417-4ef4-8471-a50e6a78071c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d5fbd8-9417-4ef4-8471-a50e6a78071c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b510fd7-e796-44c0-9727-2a6bfed702ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Volume 887cadd5-97fb-4fbe-99c7-3d4109c36a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d', 'volume_size': 1}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:18 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311783470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887cadd5-97fb-4fbe-99c7-3d4109c36a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:18Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Creating volume 887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04b4912-5a70-4fee-aff2-aa77eb7ca7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d9731b-9689-444b-8587-e594c62fe4db', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:18 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d 1073741824
Nov 05 04:03:18 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef02ed75-9ce5-45c1-ac32-e04ba3b53e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Volume volume-d8d9731b-9689-444b-8587-e594c62fe4db (d8d9731b-9689-444b-8587-e594c62fe4db): created successfully
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef02ed75-9ce5-45c1-ac32-e04ba3b53e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (dd6f250a-bb68-45aa-a4bd-81d2614ad1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dd5e30d4-e2cd-4558-8499-3ff51481ffda tempest-ProjectReaderTests-1959155406 None] Created volume successfully.
Nov 05 04:03:19 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d 1073741824" returned: 0 in 0.411s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:19 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d
Nov 05 04:03:19 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:19 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b510fd7-e796-44c0-9727-2a6bfed702ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b30e2a-3ea7-4370-b12c-83404b246209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Volume volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d (887cadd5-97fb-4fbe-99c7-3d4109c36a4d): created successfully
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b30e2a-3ea7-4370-b12c-83404b246209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (3bffeaf4-771b-4039-a8c7-1eb6d8caeb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d2ece71b-e2f2-4aac-b0b2-dbb7d8b8ef04 tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-d8d9731b-9689-444b-8587-e594c62fe4db-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-d8d9731b-9689-444b-8587-e594c62fe4db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-quobyte-d8d9731b-9689-444b-8587-e594c62fe4db" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-d8d9731b-9689-444b-8587-e594c62fe4db" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70384f1-1c16-494a-8307-5bf42cbf1619]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:20 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db
Nov 05 04:03:20 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:20 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:20 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db
Nov 05 04:03:20 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 77612fcc-c671-448a-8d9a-762526efcf4a of volume 887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:20 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-d8d9731b-9689-444b-8587-e594c62fe4db" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e83f45e-ee36-4a1f-89a2-b1cd465840e5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-d8d9731b-9689-444b-8587-e594c62fe4db" released by "delete_volume" :: held 0.699s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Created reservations ['f9b99906-38c7-4f51-bb71-82dc86537e73', '8ec77901-c1ec-4b07-89f9-df82a0ebffcd', 'f8106970-6aae-437d-8100-e38c9694b910', '80f5fbf8-08a4-429b-b60e-e8ff383e2bf5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:20 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d
Nov 05 04:03:20 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:21 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:21 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:21 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:21 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Deleted volume successfully.
Nov 05 04:03:21 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a 1G
Nov 05 04:03:21 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1747d93d-d23e-4114-a628-7a44ecdd2617 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-d8d9731b-9689-444b-8587-e594c62fe4db-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:21 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a 1G" returned: 0 in 0.516s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (7088ed80-5314-483e-9751-1eeaafc059ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:21 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a
Nov 05 04:03:21 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fe8fb9-c9e3-4bb5-9281-b610cf9420e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fe8fb9-c9e3-4bb5-9281-b610cf9420e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061360060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688ae5a-8e65-4a64-95c0-da79ea38f381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:22Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17718e9f-b86d-4c33-a487-56dce3629f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17718e9f-b86d-4c33-a487-56dce3629f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af61ad72-4814-41ad-bdab-5706161bf4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af61ad72-4814-41ad-bdab-5706161bf4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6688ae5a-8e65-4a64-95c0-da79ea38f381', 'volume_name': 'volume-6688ae5a-8e65-4a64-95c0-da79ea38f381', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4719bd9e-efb3-47ba-871c-e921d0631f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4719bd9e-efb3-47ba-871c-e921d0631f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309e926c-d73e-4680-96e5-d3cebd64e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Volume 6688ae5a-8e65-4a64-95c0-da79ea38f381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6688ae5a-8e65-4a64-95c0-da79ea38f381', 'volume_size': 1}
Nov 05 04:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:22 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:22 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a is being set with open permissions: ugo+rw
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:22 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a
Nov 05 04:03:22 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:22 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:22 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.info
Nov 05 04:03:22 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:22 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.info" returned: 0 in 0.261s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:22 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.info is being set with open permissions: ugo+rw
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:22 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.info
Nov 05 04:03:22 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:22 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.info" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061360060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688ae5a-8e65-4a64-95c0-da79ea38f381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:22Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Creating volume 6688ae5a-8e65-4a64-95c0-da79ea38f381 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:22 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381 1073741824
Nov 05 04:03:22 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d3f3a2ca-c34e-4c70-8618-96e50fcc825c tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:03:23 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381 1073741824" returned: 0 in 0.439s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:23 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381
Nov 05 04:03:23 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:23 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381" returned: 0 in 0.254s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309e926c-d73e-4680-96e5-d3cebd64e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6688ae5a-8e65-4a64-95c0-da79ea38f381', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfa79cc-0a81-4c03-851e-a105b7ec939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Volume volume-6688ae5a-8e65-4a64-95c0-da79ea38f381 (6688ae5a-8e65-4a64-95c0-da79ea38f381): created successfully
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfa79cc-0a81-4c03-851e-a105b7ec939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (7088ed80-5314-483e-9751-1eeaafc059ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6c7a61d4-e979-408c-ba36-06d8a3e7243f tempest-ProjectReaderTests-1959155406 None] Created volume successfully.
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-6688ae5a-8e65-4a64-95c0-da79ea38f381-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-6688ae5a-8e65-4a64-95c0-da79ea38f381-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-quobyte-6688ae5a-8e65-4a64-95c0-da79ea38f381" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-77612fcc-c671-448a-8d9a-762526efcf4a-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-6688ae5a-8e65-4a64-95c0-da79ea38f381" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-77612fcc-c671-448a-8d9a-762526efcf4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c669dde0-acef-4916-a45e-10a8cd2364c4]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-77612fcc-c671-448a-8d9a-762526efcf4a" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-77612fcc-c671-448a-8d9a-762526efcf4a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 77612fcc-c671-448a-8d9a-762526efcf4a of volume 887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf48fe5-0bbc-4b91-a357-024e038d9ef7]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:24 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381
Nov 05 04:03:24 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:24 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a
Nov 05 04:03:24 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:24 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:24 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381
Nov 05 04:03:24 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:24 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a" returned: 0 in 0.413s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a625b3-a1ba-4174-baf1-88d4e61dc8d6]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:24 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d
Nov 05 04:03:24 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:24 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-6688ae5a-8e65-4a64-95c0-da79ea38f381" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-6688ae5a-8e65-4a64-95c0-da79ea38f381" released by "delete_volume" :: held 0.761s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Created reservations ['2b49ccc2-89f0-40b5-b697-bf4cb5977da9', '117eeb4f-d903-4c85-b66d-f085d1b64d6c', '040c688c-0ed2-4a64-8015-e7cd5bb8780f', '0d32c70b-6965-4165-bf08-8bb72355999a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:24 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:24 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:24 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:25 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a
Nov 05 04:03:25 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:25 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.272s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Deleted volume successfully.
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe3ef2e-2ae8-47fd-9c80-0552ba0bafe2 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-6688ae5a-8e65-4a64-95c0-da79ea38f381-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:25 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:25 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a
Nov 05 04:03:25 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (364b07f3-c8f3-42c9-98b1-eef8a521627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed30b175-5aa2-44a7-8df2-ed83dbafab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed30b175-5aa2-44a7-8df2-ed83dbafab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376221033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac33c47-61ac-4dd4-a088-206c108ef9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:26Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8ed7bf-6da3-497b-a69f-2c1d274edd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8ed7bf-6da3-497b-a69f-2c1d274edd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88878da3-73b6-430c-8fc8-2f8735f0ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88878da3-73b6-430c-8fc8-2f8735f0ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac33c47-61ac-4dd4-a088-206c108ef9cf', 'volume_name': 'volume-cac33c47-61ac-4dd4-a088-206c108ef9cf', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d89bff-5d24-4e17-8bb4-2a287d088ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d89bff-5d24-4e17-8bb4-2a287d088ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac2b2a7-9b7d-4a23-a46e-ac83118497d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Volume cac33c47-61ac-4dd4-a088-206c108ef9cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac33c47-61ac-4dd4-a088-206c108ef9cf', 'volume_size': 1}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376221033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac33c47-61ac-4dd4-a088-206c108ef9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:26Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Creating volume cac33c47-61ac-4dd4-a088-206c108ef9cf {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:25 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:25 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d.77612fcc-c671-448a-8d9a-762526efcf4a" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:25 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf 1073741824
Nov 05 04:03:25 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-77612fcc-c671-448a-8d9a-762526efcf4a" released by "_delete_snapshot" :: held 1.649s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" released by "delete_snapshot" :: held 1.680s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Created reservations ['dd63f427-c4a1-480e-ba85-68dadbeb867b', 'c713a7f6-f54a-44f9-8b4a-37a497f94fb3', '3f128e6f-0438-4b89-861e-5092707a57dd', '8146b52c-cb52-4dd6-aad8-6a1363179bb6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bd8b688f-bf23-4c11-b71f-793fd2b04012 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-77612fcc-c671-448a-8d9a-762526efcf4a-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:26 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf 1073741824" returned: 0 in 0.467s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-887cadd5-97fb-4fbe-99c7-3d4109c36a4d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-887cadd5-97fb-4fbe-99c7-3d4109c36a4d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:26 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf
Nov 05 04:03:26 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bb6671-504a-4a59-b49e-73b3b4159a20]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:26 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d
Nov 05 04:03:26 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:26 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac2b2a7-9b7d-4a23-a46e-ac83118497d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac33c47-61ac-4dd4-a088-206c108ef9cf', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a74583-d846-4fe7-99cc-f5487ef1d25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Volume volume-cac33c47-61ac-4dd4-a088-206c108ef9cf (cac33c47-61ac-4dd4-a088-206c108ef9cf): created successfully
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a74583-d846-4fe7-99cc-f5487ef1d25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (364b07f3-c8f3-42c9-98b1-eef8a521627f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-594245b6-e451-429c-b1fa-fd7baac94c21 tempest-ProjectReaderTests-1959155406 None] Created volume successfully.
Nov 05 04:03:26 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:26 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d
Nov 05 04:03:26 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:27 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-887cadd5-97fb-4fbe-99c7-3d4109c36a4d" released by "delete_volume" :: held 0.760s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Created reservations ['de798681-bc26-4da4-9dc9-221373e645c1', '1a8a7174-d62f-4689-aa02-ca2e8991fb48', 'd411a603-aee4-41ef-b6fd-6ecb1a8210fc', '0fabfd87-7385-41e1-bd11-52a888a6c518'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:27 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:27 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:27 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-aa89b8a5-8de0-416f-ad56-bf4b82b7e9e8 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-887cadd5-97fb-4fbe-99c7-3d4109c36a4d-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-cac33c47-61ac-4dd4-a088-206c108ef9cf-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Lock "cinder-cac33c47-61ac-4dd4-a088-206c108ef9cf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-quobyte-cac33c47-61ac-4dd4-a088-206c108ef9cf" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-cac33c47-61ac-4dd4-a088-206c108ef9cf" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad02889d-278b-45c1-a0b9-da681ad6f462]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (9e28a150-e409-4926-b57f-2260752b80d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3f1558-5364-4e8f-af85-f6af99313a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3f1558-5364-4e8f-af85-f6af99313a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192189935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61619d6b-53be-4cfe-bee1-b8c1c14c7f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:28Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf58efc0-5fa1-43ed-8360-c850ed67482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf58efc0-5fa1-43ed-8360-c850ed67482c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dd9fba-b24d-4ad0-a7fe-24b02b9677b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dd9fba-b24d-4ad0-a7fe-24b02b9677b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61619d6b-53be-4cfe-bee1-b8c1c14c7f35', 'volume_name': 'volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:28 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf
Nov 05 04:03:28 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0632f942-abc3-4565-aac2-f09c9f4c0651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0632f942-abc3-4565-aac2-f09c9f4c0651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34540b94-408b-42f2-a0b1-eda30a80236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:28 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Volume 61619d6b-53be-4cfe-bee1-b8c1c14c7f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35', 'volume_size': 1}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192189935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61619d6b-53be-4cfe-bee1-b8c1c14c7f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:28Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Creating volume 61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:28 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:28 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 1073741824
Nov 05 04:03:28 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:28 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:28 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf
Nov 05 04:03:28 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:28 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 1073741824" returned: 0 in 0.461s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:28 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35
Nov 05 04:03:28 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:28 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-cac33c47-61ac-4dd4-a088-206c108ef9cf" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-cac33c47-61ac-4dd4-a088-206c108ef9cf" released by "delete_volume" :: held 0.733s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Created reservations ['327c5aed-00dd-4358-a221-3e1a759de2cd', '012022a6-3680-478d-8dd3-fbb38b5c6522', 'ad3f620c-4a6e-44c7-9ca7-d7af165a8ed6', 'a21673cb-38ec-4d76-b714-2b86e56fb0aa'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:28 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:28 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:28 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34540b94-408b-42f2-a0b1-eda30a80236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e53fec-37dc-469b-b10b-b1cb34fc9be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:28 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Volume volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 (61619d6b-53be-4cfe-bee1-b8c1c14c7f35): created successfully
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e53fec-37dc-469b-b10b-b1cb34fc9be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (9e28a150-e409-4926-b57f-2260752b80d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-013108ff-9875-4c9f-8900-f275fea18676 tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:03:29 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Deleted volume successfully.
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ee631bcf-5ebe-47d1-af24-7d168a763bda tempest-ProjectReaderTests-1959155406 None] Lock "cinder-cac33c47-61ac-4dd4-a088-206c108ef9cf-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (1cf74249-92ec-4d7a-963c-1c6505ae9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c5a2bf-2049-4e70-9adb-22e769222dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c5a2bf-2049-4e70-9adb-22e769222dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428039056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2370f2ad-e0e1-45e8-9063-05822dcca38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:29Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df36fdd9-68fc-4ee0-b68a-de766b6be140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df36fdd9-68fc-4ee0-b68a-de766b6be140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a39aa0-d7ae-40c5-8f97-79fc3ccb6381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a39aa0-d7ae-40c5-8f97-79fc3ccb6381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2370f2ad-e0e1-45e8-9063-05822dcca38f', 'volume_name': 'volume-2370f2ad-e0e1-45e8-9063-05822dcca38f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b9e8b-94e9-4056-9583-09b218d30f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b9e8b-94e9-4056-9583-09b218d30f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ea07ac-3ac1-4325-9271-bc02267bb34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:29 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Volume 2370f2ad-e0e1-45e8-9063-05822dcca38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2370f2ad-e0e1-45e8-9063-05822dcca38f', 'volume_size': 1}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428039056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2370f2ad-e0e1-45e8-9063-05822dcca38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626eae1bcc34ff8ab5c8f91f04ba315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:29Z,use_quota=True,user_id='b83b119040ff46d69f4969048977e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Creating volume 2370f2ad-e0e1-45e8-9063-05822dcca38f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:29 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:29 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f 1073741824
Nov 05 04:03:29 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:29 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f 1073741824" returned: 0 in 0.463s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:30 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f
Nov 05 04:03:30 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:30 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.143s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ea07ac-3ac1-4325-9271-bc02267bb34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2370f2ad-e0e1-45e8-9063-05822dcca38f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27370184-d253-44c0-94ac-94a130ff6cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 83cbd0b2-f8c3-4d82-a488-c4da00ac019d of volume 61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:30 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Volume volume-2370f2ad-e0e1-45e8-9063-05822dcca38f (2370f2ad-e0e1-45e8-9063-05822dcca38f): created successfully
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27370184-d253-44c0-94ac-94a130ff6cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Flow 'volume_create_manager' (1cf74249-92ec-4d7a-963c-1c6505ae9301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae60dd-b7bc-4a18-b622-1ed67a06ac72]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-49942ca4-bff6-4f3d-9d19-70e0582f3cb9 tempest-ProjectReaderTests-1959155406 None] Created volume successfully.
Nov 05 04:03:30 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35
Nov 05 04:03:30 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:30 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:30 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d 1G
Nov 05 04:03:30 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:31 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d 1G" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d
Nov 05 04:03:31 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-2370f2ad-e0e1-45e8-9063-05822dcca38f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:31 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:31 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d is being set with open permissions: ugo+rw
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-2370f2ad-e0e1-45e8-9063-05822dcca38f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=241,cinder:UPDATE=286,cinder:INSERT=75,cinder:DELETE=21 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:03:31 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d
Nov 05 04:03:31 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=289,cinder:DELETE=27,cinder:SELECT=202,cinder:INSERT=76 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "cinder-quobyte-2370f2ad-e0e1-45e8-9063-05822dcca38f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-2370f2ad-e0e1-45e8-9063-05822dcca38f" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e161ea-8e14-4605-8992-c83d15a52af0]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f
Nov 05 04:03:31 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:31 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.info
Nov 05 04:03:31 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:32 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f" returned: 0 in 0.411s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:32 devstack sudo[106590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f
Nov 05 04:03:32 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:32 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.info" returned: 0 in 0.290s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.info is being set with open permissions: ugo+rw
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:32 devstack sudo[106593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.info
Nov 05 04:03:32 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:32 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-2370f2ad-e0e1-45e8-9063-05822dcca38f" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-quobyte-2370f2ad-e0e1-45e8-9063-05822dcca38f" released by "delete_volume" :: held 0.730s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Created reservations ['6fa21c86-734c-4820-9aec-11ceae96a88c', '2e773eb1-5d63-4bd1-a4dc-63800ccae94a', '79395fdd-33b4-43aa-a482-913bae2b073c', 'cfc3513b-965b-48e4-930a-247a0b87a0e0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:32 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.info" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5fa7eb82-c5a3-4bda-a0d1-b9a6635665f4 tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:32 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:32 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:32 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Deleted volume successfully.
Nov 05 04:03:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d1b49bfc-cdb6-4810-9c48-13afba8408f0 tempest-ProjectReaderTests-1959155406 None] Lock "cinder-2370f2ad-e0e1-45e8-9063-05822dcca38f-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-83cbd0b2-f8c3-4d82-a488-c4da00ac019d-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-83cbd0b2-f8c3-4d82-a488-c4da00ac019d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-83cbd0b2-f8c3-4d82-a488-c4da00ac019d" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-83cbd0b2-f8c3-4d82-a488-c4da00ac019d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 83cbd0b2-f8c3-4d82-a488-c4da00ac019d of volume 61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b7add-1fe1-4038-a04f-44004e2c8ae5]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:33 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d
Nov 05 04:03:33 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:33 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea419a50-6e7e-48f0-9ea1-b5b513a15b83]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:34 devstack sudo[106605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35
Nov 05 04:03:34 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:34 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:34 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d
Nov 05 04:03:34 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:34 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d" returned: 0 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:34 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d
Nov 05 04:03:34 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:34 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35.83cbd0b2-f8c3-4d82-a488-c4da00ac019d" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-83cbd0b2-f8c3-4d82-a488-c4da00ac019d" released by "_delete_snapshot" :: held 1.538s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" released by "delete_snapshot" :: held 1.564s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Created reservations ['3df197c8-12fc-48b9-a3f4-1d95c88100e7', 'af6f24a4-7ec8-4a6a-b125-d99132839716', 'd0b30479-9dfc-4512-93af-19d37c7c8181', 'aab8c0b6-5a2b-49f9-9d6a-0c271efa00cc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1134dcef-8a22-4675-9395-a023fc5d0cc4 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-83cbd0b2-f8c3-4d82-a488-c4da00ac019d-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-61619d6b-53be-4cfe-bee1-b8c1c14c7f35-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-61619d6b-53be-4cfe-bee1-b8c1c14c7f35-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f7be7e-80e7-4307-b155-5af7921344fd]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:35 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35
Nov 05 04:03:35 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:36 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35
Nov 05 04:03:36 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-61619d6b-53be-4cfe-bee1-b8c1c14c7f35" released by "delete_volume" :: held 0.651s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Created reservations ['e6eca640-ddf9-4c26-afff-15cb28796668', '14398b8b-58ed-4084-bfc9-5c797ef07a35', '3da85e4d-8839-4581-a749-ad343955402e', 'ba39d578-ac3c-4abf-ae8b-c32ebafb51bf'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:36 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:36 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:03:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8364323e-e8ca-4414-9acd-0fe4b17bb7e2 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-61619d6b-53be-4cfe-bee1-b8c1c14c7f35-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (2a58b685-08a4-4adc-8684-a08657fdd2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e23498b-e4dd-407c-a169-5c3dcb8f1b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e23498b-e4dd-407c-a169-5c3dcb8f1b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141358337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62269ac8-6248-47bd-8515-264f690ac5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:37Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5934fc03-3d2e-4b20-898e-2e55487a234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5934fc03-3d2e-4b20-898e-2e55487a234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0003ea1b-54b6-4796-942a-7f51ffb31b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0003ea1b-54b6-4796-942a-7f51ffb31b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62269ac8-6248-47bd-8515-264f690ac5e1', 'volume_name': 'volume-62269ac8-6248-47bd-8515-264f690ac5e1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3188935-63f7-4801-95b8-39dabfdf3c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3188935-63f7-4801-95b8-39dabfdf3c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262f9366-0df3-4586-ba40-d0629d034b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Volume 62269ac8-6248-47bd-8515-264f690ac5e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62269ac8-6248-47bd-8515-264f690ac5e1', 'volume_size': 1}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141358337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62269ac8-6248-47bd-8515-264f690ac5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5dbe3498654a2ca955f91080c58d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:37Z,use_quota=True,user_id='37bd3aca1a5e4eb8a62e9b74ba9a43bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Creating volume 62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:37 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:37 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 1073741824
Nov 05 04:03:37 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:37 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 1073741824" returned: 0 in 0.439s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:37 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1
Nov 05 04:03:37 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:37 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262f9366-0df3-4586-ba40-d0629d034b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62269ac8-6248-47bd-8515-264f690ac5e1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7baac2c-051e-4ba1-b1d8-6decebf7149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Volume volume-62269ac8-6248-47bd-8515-264f690ac5e1 (62269ac8-6248-47bd-8515-264f690ac5e1): created successfully
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7baac2c-051e-4ba1-b1d8-6decebf7149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Flow 'volume_create_manager' (2a58b685-08a4-4adc-8684-a08657fdd2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c1b2012e-84fd-4e84-a71e-f634899715a2 tempest-ProjectMemberTests-1514496126 None] Created volume successfully.
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Creating offline snapshot 24132158-6236-42ce-9bb7-c700939ee0bc of volume 62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f698d59b-2008-4266-b8cd-922b4322a8ae]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:38 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1
Nov 05 04:03:38 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:38 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:38 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc 1G
Nov 05 04:03:38 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:39 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc 1G" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62269ac8-6248-47bd-8515-264f690ac5e1 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:39 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62269ac8-6248-47bd-8515-264f690ac5e1 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc
Nov 05 04:03:39 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:39 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62269ac8-6248-47bd-8515-264f690ac5e1 -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:39 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc is being set with open permissions: ugo+rw
Nov 05 04:03:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:39 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc
Nov 05 04:03:39 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:39 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:39 devstack sudo[106663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.info
Nov 05 04:03:39 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:40 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.info" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:40 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.info is being set with open permissions: ugo+rw
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:40 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.info
Nov 05 04:03:40 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:40 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.info" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5e471b41-e444-490a-b42f-04d87bf5152b tempest-ProjectMemberTests-1514496126 None] Create snapshot completed successfully
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-24132158-6236-42ce-9bb7-c700939ee0bc-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Lock "cinder-24132158-6236-42ce-9bb7-c700939ee0bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-62269ac8-6248-47bd-8515-264f690ac5e1" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-62269ac8-6248-47bd-8515-264f690ac5e1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-24132158-6236-42ce-9bb7-c700939ee0bc" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-24132158-6236-42ce-9bb7-c700939ee0bc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Deleting offline snapshot 24132158-6236-42ce-9bb7-c700939ee0bc of volume 62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] snapshot_file for this snap is: volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fa55ba-4da0-4759-a4db-7d4721cd4c8d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:40 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc
Nov 05 04:03:40 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:41 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62269ac8-6248-47bd-8515-264f690ac5e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae947cf1-1d2b-4d4c-955b-8bb7bfd2f76d]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1
Nov 05 04:03:41 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:41 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1" returned: 0 in 0.392s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc
Nov 05 04:03:41 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:41 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc" returned: 0 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc
Nov 05 04:03:41 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:42 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1.24132158-6236-42ce-9bb7-c700939ee0bc" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-24132158-6236-42ce-9bb7-c700939ee0bc" released by "_delete_snapshot" :: held 1.474s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-62269ac8-6248-47bd-8515-264f690ac5e1" released by "delete_snapshot" :: held 1.495s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Created reservations ['abe11064-6bf4-4fc2-8c62-a67881c90ddb', 'b0250cb4-ccb6-48bc-a00c-e81820db56d6', '1404772a-15c1-41e1-818e-0ce65a37717e', '76004b93-be85-4eb6-8d0f-668be2248a0c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Delete snapshot completed successfully.
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2f89ef98-3a66-4d8d-acba-b8697e4a9a0b tempest-ProjectMemberTests-1514496126 None] Lock "cinder-24132158-6236-42ce-9bb7-c700939ee0bc-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-62269ac8-6248-47bd-8515-264f690ac5e1-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-62269ac8-6248-47bd-8515-264f690ac5e1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "cinder-quobyte-62269ac8-6248-47bd-8515-264f690ac5e1" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-62269ac8-6248-47bd-8515-264f690ac5e1" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02fe26-5832-46d8-8ea9-2418edfdf8a9]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:43 devstack sudo[106687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1
Nov 05 04:03:43 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:43 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1" returned: 0 in 0.366s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:43 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1
Nov 05 04:03:43 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:43 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-62269ac8-6248-47bd-8515-264f690ac5e1" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-quobyte-62269ac8-6248-47bd-8515-264f690ac5e1" released by "delete_volume" :: held 0.686s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Created reservations ['2cf8512d-4f6e-4d4f-8060-0ae55a3b8e9b', '4ae808ab-cbc8-46f7-a26c-626941349d2e', 'd5c8df0a-c80f-4656-b946-d44ba9e71481', 'f2daab75-302e-4b9b-8a49-df6f71e89708'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:43 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:03:43 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:43 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Deleted volume successfully.
Nov 05 04:03:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-410df979-a31b-4d8f-9fa2-611fa8f50ba6 tempest-ProjectMemberTests-1514496126 None] Lock "cinder-62269ac8-6248-47bd-8515-264f690ac5e1-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=37,cinder:INSERT=11,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:03:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=34,cinder:INSERT=12,cinder:SELECT=24,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:10 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:04:10 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:10 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.256s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread count: 29 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5672}}
Nov 05 04:04:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c9b4ed41-198c-4126-8b04-934bf55edbb1 None None] thread info: [<_MainThread(MainThread, started 140302567551104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140302453747456)>, <Thread(Thread-3 (stat_writer), started daemon 140302452654208)>, <Thread(Rabbit-heartbeat, started daemon 140302456367680)>, <Thread(Thread-5 (_runner), started daemon 140302451419392)>, <Thread(Thread-7 (_runner), started daemon 140302451481984)>, <Thread(fd_logger, started daemon 140302449445440)>, <Thread(privsep_reader, started daemon 140302449445824)>, <Thread(Rabbit-heartbeat, started daemon 140302443556224)>, <Thread(tpool_thread_0, started daemon 140302440523456)>, <Thread(tpool_thread_1, started daemon 140302432130752)>, <Thread(tpool_thread_2, started daemon 140302423738048)>, <Thread(tpool_thread_3, started daemon 140302415328960)>, <Thread(tpool_thread_4, started daemon 140302406919872)>, <Thread(tpool_thread_5, started daemon 140302398510784)>, <Thread(tpool_thread_6, started daemon 140302390101696)>, <Thread(tpool_thread_7, started daemon 140302381692608)>, <Thread(tpool_thread_8, started daemon 140302373283520)>, <Thread(tpool_thread_9, started daemon 140302364874432)>, <Thread(tpool_thread_10, started daemon 140302356465344)>, <Thread(tpool_thread_11, started daemon 140302348056256)>, <Thread(tpool_thread_12, started daemon 140302339647168)>, <Thread(tpool_thread_13, started daemon 140302331238080)>, <Thread(tpool_thread_14, started daemon 140302322828992)>, <Thread(tpool_thread_15, started daemon 140302314419904)>, <Thread(tpool_thread_16, started daemon 140302306010816)>, <Thread(tpool_thread_17, started daemon 140302297601728)>, <Thread(tpool_thread_18, started daemon 140302289192640)>, <Thread(tpool_thread_19, started daemon 140302280783552)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5673}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Flow 'volume_create_manager' (c66b96fa-843f-48fd-b967-0e4b2acf2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a937776-4e7d-43e8-ab59-1e339a304c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a937776-4e7d-43e8-ab59-1e339a304c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1856514372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e8c935-a15b-4cfc-b6cb-3e337c18523b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c7688672dc413ca709900fd909e173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:22Z,use_quota=True,user_id='9b34b304f30f4ddf8a4b455a3a525076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c7c83c-e195-4597-8704-e8e03679d23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c7c83c-e195-4597-8704-e8e03679d23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6ee07b-eda8-4b77-9210-fbce0593b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6ee07b-eda8-4b77-9210-fbce0593b968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e8c935-a15b-4cfc-b6cb-3e337c18523b', 'volume_name': 'volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811c3dea-b8de-4593-b44e-126f37dee806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811c3dea-b8de-4593-b44e-126f37dee806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b537fabd-5e5a-45f6-a6c5-9be8c9924126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Volume 30e8c935-a15b-4cfc-b6cb-3e337c18523b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b', 'volume_size': 1}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9ab5eada90>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1856514372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e8c935-a15b-4cfc-b6cb-3e337c18523b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c7688672dc413ca709900fd909e173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:22Z,use_quota=True,user_id='9b34b304f30f4ddf8a4b455a3a525076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Creating volume 30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] casted to osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a
Nov 05 04:04:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:22 devstack sudo[106749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b 1073741824
Nov 05 04:04:22 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:23 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b 1073741824" returned: 0 in 0.465s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:23 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b
Nov 05 04:04:23 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:23 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b537fabd-5e5a-45f6-a6c5-9be8c9924126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4cf25d-7aad-4147-9b18-8e78d3767a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Volume volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b (30e8c935-a15b-4cfc-b6cb-3e337c18523b): created successfully
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4cf25d-7aad-4147-9b18-8e78d3767a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Flow 'volume_create_manager' (c66b96fa-843f-48fd-b967-0e4b2acf2e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d4504467-eb52-4aa3-835f-7eb1e5145003 tempest-SnapshotDependencyTests-159514346 None] Created volume successfully.
Nov 05 04:04:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Creating offline snapshot 8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 of volume 30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0493e0b3-48cd-42d9-9e4d-c3a9bfb9f51b]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:25 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b
Nov 05 04:04:25 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:25 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b" returned: 0 in 0.397s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:25 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 1G
Nov 05 04:04:25 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:25 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 1G" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:25 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3
Nov 05 04:04:25 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b -F qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:26 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 is being set with open permissions: ugo+rw
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:26 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3
Nov 05 04:04:26 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:26 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.info
Nov 05 04:04:26 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.info" returned: 0 in 0.253s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:26 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.info is being set with open permissions: ugo+rw
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:26 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.info
Nov 05 04:04:26 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.info" returned: 0 in 0.253s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4e2ff3d6-8aa4-47a5-9638-b3c30bd4bdd2 tempest-SnapshotDependencyTests-159514346 None] Create snapshot completed successfully
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Flow 'volume_create_manager' (a2038320-4f00-48c9-9193-f3971167abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b394443-ef0f-4b98-b438-0bbc3caa76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b394443-ef0f-4b98-b438-0bbc3caa76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eac0e77-cf9d-4709-9024-ec48707dcaa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c7688672dc413ca709900fd909e173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b2704a5-2d3e-43db-9aa9-d7d5101da7b3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:28Z,use_quota=True,user_id='9b34b304f30f4ddf8a4b455a3a525076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93694bd1-e37d-4e85-a869-c564a2f47271),volume_type_id=93694bd1-e37d-4e85-a869-c564a2f47271)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b789d0-9413-4374-ac38-a3c463462bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b789d0-9413-4374-ac38-a3c463462bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725a0535-9664-400c-a42a-b8186d586af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725a0535-9664-400c-a42a-b8186d586af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4eac0e77-cf9d-4709-9024-ec48707dcaa3', 'volume_name': 'volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3', 'volume_size': 1, 'snapshot_id': '8b2704a5-2d3e-43db-9aa9-d7d5101da7b3'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569958a9-f7b7-4733-a91e-d23aa2877770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569958a9-f7b7-4733-a91e-d23aa2877770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7127f483-d5bb-421f-8d21-0c06d40b1972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Volume 4eac0e77-cf9d-4709-9024-ec48707dcaa3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3', 'volume_size': 1, 'snapshot_id': '8b2704a5-2d3e-43db-9aa9-d7d5101da7b3'}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-quobyte-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3-4eac0e77-cf9d-4709-9024-ec48707dcaa3" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3-4eac0e77-cf9d-4709-9024-ec48707dcaa3" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Creating volume 4eac0e77-cf9d-4709-9024-ec48707dcaa3 from snapshot 8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Selected osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-quobyte-4eac0e77-cf9d-4709-9024-ec48707dcaa3" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-4eac0e77-cf9d-4709-9024-ec48707dcaa3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] snapshot: 8b2704a5-2d3e-43db-9aa9-d7d5101da7b3, volume: 4eac0e77-cf9d-4709-9024-ec48707dcaa3,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2ca86-fe6f-49c9-88cd-41d460089683]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:27 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3
Nov 05 04:04:27 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:28 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7206a3e-71a6-4a76-aee9-b006f2e0a32f]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:28 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b
Nov 05 04:04:28 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:28 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Path /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:04:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:28 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3
Nov 05 04:04:28 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3" returned: 0 in 5.828s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Image conversion details: src /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:04:34 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Converted 1024.00 MB image at 175.63 MB/s
Nov 05 04:04:34 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 is being set with open permissions: ugo+rw
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:34 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3
Nov 05 04:04:34 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:34 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-4eac0e77-cf9d-4709-9024-ec48707dcaa3" released by "_copy_volume_from_snapshot" :: held 6.916s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3-4eac0e77-cf9d-4709-9024-ec48707dcaa3" released by "_create_volume_from_snapshot" :: held 6.978s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.993s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7127f483-d5bb-421f-8d21-0c06d40b1972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3', 'volume_size': 1, 'snapshot_id': '8b2704a5-2d3e-43db-9aa9-d7d5101da7b3'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6f3de8-5da3-4038-83c3-5a54f35ab79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Volume volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 (4eac0e77-cf9d-4709-9024-ec48707dcaa3): created successfully
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6f3de8-5da3-4038-83c3-5a54f35ab79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Flow 'volume_create_manager' (a2038320-4f00-48c9-9193-f3971167abfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-19ea34db-03d5-4ea7-b88f-fc92d78eff96 tempest-SnapshotDependencyTests-159514346 None] Created volume successfully.
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-quobyte-30e8c935-a15b-4cfc-b6cb-3e337c18523b" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-30e8c935-a15b-4cfc-b6cb-3e337c18523b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-quobyte-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Deleting offline snapshot 8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 of volume 30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] snapshot_file for this snap is: volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e23875d-cc63-4228-80d6-7031cbd1a357]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:35 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3
Nov 05 04:04:35 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:35 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" returned: 0 in 0.330s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2008222f-02f9-4dc5-824a-0a29151bae98]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:35 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b
Nov 05 04:04:35 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:36 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b" returned: 0 in 0.492s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:36 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3
Nov 05 04:04:36 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:36 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:36 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3
Nov 05 04:04:36 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:36 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b.8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3" released by "_delete_snapshot" :: held 1.496s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-30e8c935-a15b-4cfc-b6cb-3e337c18523b" released by "delete_snapshot" :: held 1.516s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Created reservations ['16151d7d-de61-413b-96c1-141173225023', '3b781ff8-a2d2-4bb2-80da-035f55159127', 'b68b4f29-af19-484e-ad7a-6ba6f5035c52', '968579aa-c4f0-4e03-a75c-a0e2a9cc2299'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Delete snapshot completed successfully.
Nov 05 04:04:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ef67bbb3-5bce-4a41-a8fa-223f2e39abd5 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-8b2704a5-2d3e-43db-9aa9-d7d5101da7b3-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-30e8c935-a15b-4cfc-b6cb-3e337c18523b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-30e8c935-a15b-4cfc-b6cb-3e337c18523b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-quobyte-30e8c935-a15b-4cfc-b6cb-3e337c18523b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-30e8c935-a15b-4cfc-b6cb-3e337c18523b" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8da49a6-6647-4f7d-911a-839fbdf90599]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:37 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b
Nov 05 04:04:37 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:37 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:37 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b
Nov 05 04:04:37 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:38 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-30e8c935-a15b-4cfc-b6cb-3e337c18523b" returned: 0 in 0.241s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-30e8c935-a15b-4cfc-b6cb-3e337c18523b" released by "delete_volume" :: held 0.675s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Created reservations ['4619ae94-db0c-4265-af90-12467724a960', '08298422-8539-4ed9-8e74-7867a782e7be', 'feda7cbc-62c1-4b01-98f1-16d3d92be213', '5b67fc13-62cc-4fe5-a195-e584b3f15498'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:38 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:04:38 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:38 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Deleted volume successfully.
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551c90a6-87fd-4e3a-8e4d-a3470bcf8f36 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-30e8c935-a15b-4cfc-b6cb-3e337c18523b-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-4eac0e77-cf9d-4709-9024-ec48707dcaa3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-4eac0e77-cf9d-4709-9024-ec48707dcaa3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "cinder-quobyte-4eac0e77-cf9d-4709-9024-ec48707dcaa3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-4eac0e77-cf9d-4709-9024-ec48707dcaa3" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d82e689-1234-4379-b6de-5094f428a4fa]: (4, 'qcow2') {{(pid=87876) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:38 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3
Nov 05 04:04:38 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:38 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:38 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3
Nov 05 04:04:38 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:39 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e/volume-4eac0e77-cf9d-4709-9024-ec48707dcaa3" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-quobyte-4eac0e77-cf9d-4709-9024-ec48707dcaa3" released by "delete_volume" :: held 0.680s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Created reservations ['0735d928-5143-4617-85f2-1af6fa94ff02', '7fd0e873-3d58-4f5b-8715-a8a558f2bdd1', '5ab33543-2822-4379-865b-7ec066ce48c9', '452351af-d1be-4a8d-a4d8-4be150112335'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1e2e4106-20d7-4aa4-9e1b-e43096d22b8a'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:39 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e
Nov 05 04:04:39 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:39 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d22c418255b8d83638153914f16b292e" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Deleted volume successfully.
Nov 05 04:04:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3e9affaf-cf29-497e-9dd3-d64ce05f0b95 tempest-SnapshotDependencyTests-159514346 None] Lock "cinder-4eac0e77-cf9d-4709-9024-ec48707dcaa3-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=28,cinder:SELECT=31,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:04:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=21,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}